-- Logs begin at Mon 2021-12-13 22:03:11 UTC, end at Mon 2021-12-13 23:20:21 UTC. -- Dec 13 22:54:48.515950 dv-cinder-796286-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 13 22:54:48.525881 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 13 22:54:48 2021] *** Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: nodename: dv-cinder-796286-23-iscsi Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: machine: x86_64 Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: clock source: unix Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: pcre jit disabled Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: detected number of CPU cores: 4 Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: current working directory: / Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: detected binary path: /usr/bin/uwsgi-core Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: your processes number limit is 47680 Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: your memory page size is 4096 bytes Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: detected max file descriptor number: 2048 Dec 13 22:54:48.528190 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: lock engine: pthread robust mutexes Dec 13 22:54:48.529177 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: thunder lock: enabled Dec 13 22:54:48.529177 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 13 22:54:48.529177 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 13 22:54:48.576770 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: Python main interpreter initialized at 0x55db53f679c0 Dec 13 22:54:48.576770 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: python threads support enabled Dec 13 22:54:48.576770 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: your server socket listen backlog is limited to 100 connections Dec 13 22:54:48.576770 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: your mercy for graceful operations on workers is 90 seconds Dec 13 22:54:48.577200 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: mapped 403077 bytes (393 KB) for 2 cores Dec 13 22:54:48.577200 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: *** Operational MODE: preforking *** Dec 13 22:54:48.577456 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: *** uWSGI is running in multiple interpreter mode *** Dec 13 22:54:48.577456 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: spawned uWSGI master process (pid: 101863) Dec 13 22:54:48.577663 dv-cinder-796286-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 13 22:54:48.578339 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: spawned uWSGI worker 1 (pid: 101864, cores: 1) Dec 13 22:54:48.578485 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: spawned uWSGI worker 2 (pid: 101865, cores: 1) Dec 13 22:54:48.578645 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 13 22:54:50.293817 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 22:54:50.293817 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: from cryptography.utils import int_from_bytes Dec 13 22:54:50.294473 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 22:54:50.294473 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: from cryptography.utils import int_from_bytes Dec 13 22:54:50.294603 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 22:54:50.294603 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: from cryptography.utils import int_from_bytes Dec 13 22:54:50.294603 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 22:54:50.294603 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: from cryptography.utils import int_from_bytes Dec 13 22:54:52.865365 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 22:54:52.866014 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 22:54:52.866120 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 22:54:52.866459 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 22:54:52.866712 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 22:54:52.867105 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.867426 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.867745 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.868063 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.868388 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.868697 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.869016 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.869358 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.869701 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.869930 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.870221 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 22:54:52.870601 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.870699 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 22:54:52.870784 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796286-23-iscsi {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.870862 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.870936 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 22:54:52.871169 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.871309 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 22:54:52.871471 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.871559 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 22:54:52.871785 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.871971 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.872065 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.872302 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.872403 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.872622 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.872758 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.872944 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.873186 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.873299 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.874390 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.874536 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.874642 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.874736 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.874816 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.874934 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875023 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875143 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875234 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875321 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875399 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875480 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875604 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796286-23-iscsi {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875686 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875768 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.875855 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.876019 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.876114 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.876346 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.876437 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.876649 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.876745 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796286-23-iscsi {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.876955 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.877043 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.877277 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.877409 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.877617 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.877717 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.878065 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.878152 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.878373 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.878468 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.878679 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.878776 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.878999 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.879087 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.879317 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.879413 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.879628 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.879753 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.879947 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.880169 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.880253 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.880335 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.880562 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.880648 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.880874 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.880969 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.881175 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.881302 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.881504 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.881612 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796286-23-iscsi {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.881796 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.881881 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.882113 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.882218 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.882419 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.882515 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.882719 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.882883 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.882970 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.883198 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.883291 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.883508 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.883598 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.883829 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.883921 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.884154 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.884238 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.884406 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.884492 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.884654 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.884792 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.884970 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.885191 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.885427 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.885564 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.885692 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.885822 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.885998 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.886127 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.886305 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.886439 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.886610 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.886749 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.886919 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.887070 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.887225 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.887377 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.887527 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.887683 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.887830 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.887916 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.888150 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.888235 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.888466 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.888558 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.888786 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.888871 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.889092 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.889184 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.889423 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.889576 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.889671 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.889819 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.889982 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.890078 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.890303 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.890397 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.890613 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.890697 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.890923 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.891009 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.891234 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.891318 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.891540 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.891626 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.891846 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.891931 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.892153 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.892236 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.892461 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.892570 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.892763 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.892867 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.893084 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.893182 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.893419 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.893512 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.893722 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.893819 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.893970 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.894064 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.894268 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.894369 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.894570 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.894725 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.894886 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.894981 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.895191 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.895292 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.895495 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.895582 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.895799 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.895890 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.896096 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.896197 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.896399 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.896491 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.896702 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.896788 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.897011 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.897108 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.897315 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.897430 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.897638 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.897724 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.897939 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.898057 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.898242 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.898330 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.898543 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.898636 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.898842 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.898930 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.899142 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.899236 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.899448 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.899549 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.899751 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.899840 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.900054 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.900144 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.900356 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.900450 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.900708 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.900811 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.901023 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.901112 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.901352 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.901486 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.901652 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.901787 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.901956 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.902088 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.902261 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.902393 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.902553 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.902714 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.902869 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.902998 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.903168 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.903253 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.903471 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.903557 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.903796 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.903881 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.904092 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.904187 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.904397 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.904490 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.904710 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.904795 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.905015 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.905200 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.905395 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.905497 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.905633 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.905713 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.905934 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.906039 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.906234 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.906330 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.906536 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.906630 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.906838 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.906960 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.907137 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.907232 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.907433 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.907537 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.907747 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.907850 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.908054 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.908150 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.908357 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.908457 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.908660 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.908770 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.908959 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.909054 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.909262 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.909384 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.909607 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.909748 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.909912 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.910061 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.910218 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.910352 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.910521 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.910664 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.910810 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.910944 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.911115 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.911250 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.911419 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.911573 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.911704 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.911795 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.912008 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.912105 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.912308 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.912394 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.912624 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.912752 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.912943 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.913039 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.913257 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.913434 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.913587 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.913721 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.913893 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.914044 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.914213 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 22:54:52.914346 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.914523 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.914655 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.914836 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.914978 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.915154 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.915287 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.915465 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.915597 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.915780 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.915911 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.916109 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.916250 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.916501 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.916663 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.916809 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.916963 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.917125 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.917261 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.917455 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.917584 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.917772 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.917920 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.918084 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.918226 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.918405 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.918544 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.918722 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.918880 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.919034 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.919122 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.919343 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.919434 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.919654 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.919740 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.919968 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.920052 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.920277 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.920368 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.920593 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.920690 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.920907 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.920991 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.921224 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.921307 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.921564 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.921658 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.921873 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.921961 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.922177 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.922277 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.922482 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.922567 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.922792 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.922878 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.923115 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.923244 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.923416 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.923501 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.923744 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.923828 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.924050 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.924142 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.924363 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.924453 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.924670 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.924754 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.924980 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.925073 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.925290 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.925395 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.925621 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.925719 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.925930 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.926023 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.926241 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.926326 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.926546 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.926630 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.926864 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.926950 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.927171 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.927262 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.927476 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.927567 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.927786 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.927870 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.928088 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.928179 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.928752 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.928843 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.929067 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.929153 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.929402 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.929492 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.929713 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.929828 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.930026 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.930116 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.930335 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.930420 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.930648 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.930743 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.930953 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.931044 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.931268 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.931352 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.931580 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.931675 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.931891 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.931976 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.932237 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.932323 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.932548 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.932644 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.932855 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.932946 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.933155 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.933238 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.933491 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.933627 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.933798 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.933940 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.934103 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.934236 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.934410 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.934553 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.934719 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.934860 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.935023 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.935155 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.935328 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.935473 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.935632 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.935763 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.935937 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.936074 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.936241 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.936373 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.936563 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.936695 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.936879 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.937023 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.937182 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.937325 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.937504 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.937639 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.937797 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.937953 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.938146 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.938294 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.938435 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.938568 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.938750 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.938896 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.939058 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.939197 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.939365 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.939505 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.939678 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.939830 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.939985 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.940125 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.940292 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.940431 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.940601 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.940741 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.940907 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.941046 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.941212 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.941395 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.941547 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.941688 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.941850 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.941990 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.942152 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.942299 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.942442 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.942576 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.942743 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.942882 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.943066 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.943194 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.943375 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.943518 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.943691 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.943820 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.943992 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.944130 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.944306 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.944440 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.944644 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.944778 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.944960 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.945060 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.945280 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.945488 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.945637 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.945728 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.945921 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.946020 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.946231 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.946317 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.946536 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.946621 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.946849 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.946986 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.947157 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.947294 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.947464 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.947552 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.947852 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.947994 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.948281 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.948419 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.948549 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.948679 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.948848 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.948988 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.949118 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.949248 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.949420 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.949549 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.949693 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.949825 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.949983 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.950122 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.950296 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.950427 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.950624 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.950765 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.950958 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.951090 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.951268 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.951411 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.951578 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.951711 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.951891 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.952023 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.952201 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.952339 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.952509 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.952640 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.952816 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.952957 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.953122 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.953277 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.953484 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.953620 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.953761 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.953895 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.954030 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.954175 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.954346 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.954486 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.954654 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.954795 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.954958 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.955105 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.955270 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.955418 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.955575 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.955713 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.955929 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.956066 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.956198 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.956337 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.956476 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.956615 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.956756 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.956891 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.957064 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.957215 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.957933 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958077 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958207 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958335 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958463 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958591 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958724 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958861 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.958991 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.959118 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.959245 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.959385 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.959514 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.959655 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.959784 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.959912 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960040 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960127 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960258 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960346 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960470 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960595 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960720 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960844 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.960977 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.961133 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.961280 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.961470 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.961613 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.961704 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.961921 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.962010 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.962230 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.962319 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.962539 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.962627 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.962848 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.962943 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.963155 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.963286 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.963550 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.963699 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.963861 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.963993 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.964163 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.964293 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.964467 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.964611 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.964774 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.964903 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.965091 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.965222 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.965396 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.965513 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.965729 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.965860 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.966038 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.966171 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.966341 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.966486 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.966652 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.966783 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.966958 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.967060 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.967336 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.967531 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.967633 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.967861 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.967957 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.968175 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.968274 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.968486 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.968581 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.968802 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.968891 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.969116 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.969214 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.969452 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.969555 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.969767 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.969856 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.970079 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.970176 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.970384 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.970480 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.970696 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.970790 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.970981 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.971066 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.971288 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.971372 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.971596 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.971680 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.971895 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.971980 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.972197 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.972469 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.972554 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.972795 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.972891 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.973098 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.973183 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.973423 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.973525 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.973751 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.973844 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.974052 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.974146 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.974365 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.974459 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.974670 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.974755 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.974980 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.975074 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.975281 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.975366 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.975596 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.975687 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.975903 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.975986 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.976213 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.976305 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.976499 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.976593 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.976802 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.976894 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.977110 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.977201 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.977444 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.977591 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.977759 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.977845 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.978068 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.978160 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.978376 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.978469 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.978708 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.978795 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.979093 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.979183 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.979420 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.979518 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.979725 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.979814 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.980028 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.980114 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.980329 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.980413 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.980637 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.980723 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.980943 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.981030 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.981246 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.981403 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.981581 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.981723 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.981888 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.981980 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.982193 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.982286 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.982500 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.982585 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.982801 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.982885 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.983107 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.983201 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.983409 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.983495 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.983722 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.983808 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.984032 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.984121 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.984336 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.984427 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.984637 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.984722 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.984946 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.985034 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.985251 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.985359 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.985575 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.985660 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.985884 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.985971 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.986186 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.986271 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.986495 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.986578 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.986796 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.986881 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.987100 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.987192 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.987401 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.987499 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.987741 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.987845 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.988009 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.988120 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.988310 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.988408 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.988626 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.988712 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.988932 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.989022 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.989233 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.989326 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.989559 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.989654 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.989867 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.989951 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.990168 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.990265 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.990469 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.990552 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.990772 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.990855 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.991073 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.991166 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.991390 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.991517 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.991693 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.991777 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.991993 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.992100 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.992292 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.992382 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.992593 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.992678 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.992894 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.992980 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.993195 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.993279 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.993518 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.993604 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.993823 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.993910 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.994128 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.994221 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.994429 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.994580 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.994765 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.994852 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.995072 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.995165 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.995375 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.995477 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.995675 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.995767 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.995975 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.996083 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.996275 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.996372 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.996586 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.996676 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.996898 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.996990 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.997204 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.997298 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.997533 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.997619 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.997866 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.997965 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.998147 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.998248 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.998450 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.998535 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.998756 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.998843 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.999064 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.999151 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.999364 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.999448 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.999666 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.999750 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:52.999973 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.000067 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.000286 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.000371 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.000588 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.000673 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.000890 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.000982 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.001192 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.001280 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.001528 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.001617 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.001838 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.001925 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.002156 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.002241 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.002474 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.002573 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.002796 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.002881 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.003098 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.003184 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.003407 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.003500 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.003715 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.003800 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.004022 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.004115 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.004329 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.004421 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.004632 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.004722 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.004942 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.005027 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.005253 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.005389 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.005588 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.005675 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.005895 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.005979 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.006205 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.006291 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.006513 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.006598 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.006821 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.006905 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.007129 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.007219 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.007433 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.007526 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.007756 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.007904 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.008172 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.008260 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.008337 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.008482 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.008647 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.008733 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.008949 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.009040 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.009258 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.009362 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.009588 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.009686 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.009899 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.010019 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.010260 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.010407 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.010574 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.010720 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.010889 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.011025 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.011200 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.011335 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.011509 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.011648 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.011823 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.011965 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.012140 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.012281 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.012446 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.012585 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.012776 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.013003 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.013088 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.013314 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.013473 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.013646 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.013731 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.013956 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.014047 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.014261 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.014356 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.014583 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.014673 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.014870 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.015021 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.015191 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.015336 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.015497 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.015654 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.015805 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.015962 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.016111 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.016277 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.016443 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.016593 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.016749 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.016913 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.017073 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.017233 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.017517 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.017617 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.017832 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.018043 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.018206 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.018293 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.018540 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.018626 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.018851 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.018936 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.019162 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.019298 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.019483 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.019618 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.019795 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.019922 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.020116 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.020244 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.020421 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.020548 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.020730 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.020868 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.021039 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.021168 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.021383 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.021522 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.021697 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.021838 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.022005 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.022136 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.022321 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.022453 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.022625 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.022764 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.022946 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.023096 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.023268 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.023437 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.023571 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.023750 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.023884 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.024064 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.024288 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.024420 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.024610 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.024744 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.024918 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.025058 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.025241 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.025401 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.025593 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.026189 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.026323 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.026462 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.026604 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.026736 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.026877 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027009 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027141 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027272 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027434 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027580 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027719 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027851 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.027990 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.028160 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.028300 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.028426 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.028555 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.028689 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.028829 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.028957 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.029085 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.029223 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.029399 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.029540 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.029673 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.029802 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.029929 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.030083 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.030169 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.030416 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.030503 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.030725 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.030817 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.031032 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.031117 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.031343 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.031437 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.031649 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.031734 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.031956 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.032042 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.032261 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.032353 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.032566 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.032658 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.032871 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.032964 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.033179 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.033275 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.033516 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.033604 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.033823 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.033921 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.034129 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.034215 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.034455 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.034540 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.034760 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.034854 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.035085 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.035177 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.035402 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.035488 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.035717 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.035810 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.036033 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.036119 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.036335 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.036418 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.036651 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.036736 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.036952 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.037038 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.037255 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.037357 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.037584 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.037671 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.037890 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.037975 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.038195 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.038331 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.038499 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.038588 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.038803 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.038888 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.039105 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.039190 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.039408 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.039518 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.039733 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.039819 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.040036 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.040134 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.040358 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.040451 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.040667 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.040753 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.040969 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.041062 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.041271 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.041459 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.041684 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.041773 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.041988 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.042082 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.042300 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.042502 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.042608 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.042840 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.042935 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.043161 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.043248 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.043485 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.043570 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.043798 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.043891 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.044107 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.044200 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.044413 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.044498 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.044731 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.044823 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.045037 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.045121 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.045370 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.045458 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.045689 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.045786 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.045994 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.046080 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.046302 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.046386 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.046609 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.046744 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.046914 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.047007 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.047229 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.047314 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.047541 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.047628 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.047858 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.047944 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.048262 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.048389 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.048509 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.048691 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.048823 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.049003 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.049151 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.049314 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.049499 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.049644 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.049820 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.049953 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.050140 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.050261 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.050459 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.050569 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.050778 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.050869 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.051097 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.051196 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.051417 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.051501 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.051730 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.051816 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.052048 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.052143 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.052367 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.052452 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.052686 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.052775 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.053004 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.053211 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.053688 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.053977 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.054063 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.054295 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.054396 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.054610 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.054696 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.054926 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.055017 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.055240 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.055370 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.055551 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.055637 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.055864 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.055948 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.056173 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.056266 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.056486 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.056571 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.056793 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.056885 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.057145 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.057297 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.057514 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.057729 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.057848 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.058050 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.058193 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.058373 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.058541 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.058701 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.058812 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.059008 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.059109 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.059332 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.059420 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.059670 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.059770 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.059995 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.060085 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.060310 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.060398 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.060624 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.060719 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.060943 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.061039 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.061280 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.061481 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.061622 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.061796 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.061936 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.062127 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.062252 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.062453 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.062568 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.062778 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.062867 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.063095 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.063190 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.063412 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.063501 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.063739 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.063836 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.064046 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.064132 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.064351 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.064446 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.064660 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.064748 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.064969 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.065056 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.065271 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.065389 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.065617 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.065705 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.065927 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.066163 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.066251 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.066481 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.066577 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.066817 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.066906 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.067145 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.067356 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.067457 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.067707 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.067801 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.068024 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.068112 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.068349 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.068453 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.068678 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.068837 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.068974 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.069115 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.069260 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.069437 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.069602 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.069697 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.069907 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.069994 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.070209 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.070302 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.070525 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.070611 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.070826 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.070912 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.071128 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.071214 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.071431 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.071516 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.071742 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.071961 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.072056 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.072314 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.072401 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.072678 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.072766 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.073007 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.073127 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.073484 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.073572 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.073797 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.073884 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.074106 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.074192 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.074414 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.074501 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.074728 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.074820 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.075035 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.075128 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.075342 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.075427 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.075649 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.075746 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.075954 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.076047 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.076258 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.076342 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.076564 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.076833 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.076943 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.077023 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.077167 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.077260 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.077585 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.077692 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.077901 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.077994 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.078222 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.078314 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.078526 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.078764 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.078850 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.078927 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.079125 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.079210 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.079430 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.079523 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.079735 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.079826 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.080044 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.080136 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.080351 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.080435 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.080658 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.080750 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.080963 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.081048 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.081267 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.081372 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.081608 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.081694 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.081914 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.082153 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.082259 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.082520 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.082606 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.082829 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.082914 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.083135 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.083229 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.083460 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.083547 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.083768 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.083854 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.084074 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.084162 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.084378 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.084462 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.084691 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.084776 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.085002 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.085087 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.085311 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.085459 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.085642 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.085742 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.085949 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.086035 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.086260 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.086346 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.086576 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.086818 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.086905 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.087179 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.087263 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.087487 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.087572 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.087804 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.087900 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.088151 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.088274 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.088533 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.088795 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.088889 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.089026 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.089159 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.089299 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.089509 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.089655 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.089832 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.089974 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.090140 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.090290 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.090455 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.090606 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.090769 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.090923 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.091087 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.091239 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.091420 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.091584 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.091735 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.091853 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.092045 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.092169 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.092462 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.092556 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.092778 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.092871 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.093098 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.093185 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.093442 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.093532 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.093755 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.093840 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.094074 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.094159 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.094395 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.094482 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.094706 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.094790 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.095023 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.095108 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.095334 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.095419 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.095649 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.095734 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.095970 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.096064 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.096306 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.096398 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.096623 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.096709 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.096933 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.097026 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.097240 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.097352 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.097569 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.097677 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.097879 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.098011 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.098208 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.098320 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.098541 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.098626 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.098857 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.098981 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.099179 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.099267 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.099489 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.099583 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.099813 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.099901 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.100122 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.100216 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.100444 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.100531 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.100765 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.100852 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.101078 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.101163 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.101411 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.101512 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.101745 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.101832 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.102101 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.102196 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.102365 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.102458 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.102671 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.102756 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.102978 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.103072 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.103284 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.103378 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.103593 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.103678 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.103941 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.104050 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.104259 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.104354 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.104565 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.104650 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.104878 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.104961 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.105190 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.105277 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.105531 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.105618 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.105847 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.105933 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.106160 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.106253 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.106491 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.106576 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.106800 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.106884 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.107130 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.107220 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.107419 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.107507 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.107728 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.107822 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.108043 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.108129 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.108350 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.108434 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.108673 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.108768 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.108998 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.109124 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.109309 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.109449 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.109655 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.109752 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.109973 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.110058 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.110298 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.110392 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.110617 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.110705 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.110937 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.111025 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.111263 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.111356 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.111573 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.111659 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.111877 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.111961 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.112120 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 22:54:53.112206 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.112489 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.112808 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.113126 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.113489 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.113823 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.114154 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.114484 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.114835 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.115154 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.115548 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.115839 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.116158 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.116474 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.116782 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 22:54:53.117027 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 22:54:53.135748 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.140725 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.201355 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.context [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6ef68d83-174b-4609-9936-379f3e54427a(cell1) {{(pid=101865) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 22:54:53.205473 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.context [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6ef68d83-174b-4609-9936-379f3e54427a(cell1) {{(pid=101864) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 22:54:53.205637 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 22:54:53.207172 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 22:54:53.207957 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 22:54:53.209748 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 22:54:53.209886 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 22:54:53.211305 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 22:54:53.212126 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 22:54:53.214332 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 22:54:53.220666 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.224065 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.228116 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.230809 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.389849 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.390801 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 22:54:53.730404 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 22:54:53.731208 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 22:54:53.737002 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 22:54:53.737771 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 22:54:54.078420 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 22:54:54.079084 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 22:54:54.083597 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 22:54:54.083733 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 22:54:54.088788 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db53f679c0 pid: 101864 (default app) Dec 13 22:54:54.089136 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db53f679c0 pid: 101865 (default app) Dec 13 22:54:54.090898 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:54:54.092082 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-7fe89ce9-c4b4-4b2d-abad-74bd1ad5138a None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Dec 13 22:54:54.092491 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon Dec 13 22:54:54 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:16.887161 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:16.888759 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002446 Dec 13 22:56:16.889470 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:16 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 22:56:17.330982 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-8134ac39-2a1d-4dce-bef1-e209bb4f84d9 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:17.360628 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-8134ac39-2a1d-4dce-bef1-e209bb4f84d9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.464465 Dec 13 22:56:17.369422 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Dec 13 22:56:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:19.800469 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:19.801429 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-08f837c9-e484-40ee-9ef1-7dfe1757c3b1 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Dec 13 22:56:19.802118 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:19.872175 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-cf12c9f3-06d8-44f2-a064-8c9023b8a6ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "c1", "ram": 256}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:19.891125 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 22:56:19.891125 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Dec 13 22:56:19.921306 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-cf12c9f3-06d8-44f2-a064-8c9023b8a6ed admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112415 Dec 13 22:56:19.922258 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:19 2021] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:56:20.138621 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-7b31c2f3-f4fa-4f71-b56f-c646f50c1621 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:20.141099 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 22:56:20.141099 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: warnings.warn(msg) Dec 13 22:56:20.190248 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-7b31c2f3-f4fa-4f71-b56f-c646f50c1621 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.259182 Dec 13 22:56:20.192691 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Dec 13 22:56:19 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:22.621239 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-cf12c9f3-06d8-44f2-a064-8c9023b8a6ed admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:22.622898 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-cf12c9f3-06d8-44f2-a064-8c9023b8a6ed admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Dec 13 22:56:22.623596 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 22:56:22.760121 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-64926b52-4051-481f-9c1e-0dd679f40928 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:22.781773 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 22:56:22.781773 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: warnings.warn(msg) Dec 13 22:56:22.805087 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-64926b52-4051-481f-9c1e-0dd679f40928 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.174629 Dec 13 22:56:22.806135 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 22:56:22.818604 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-6934e04c-ed8f-4311-82f1-752677399d62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:22.820175 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 22:56:22.820175 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Dec 13 22:56:22.856621 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-6934e04c-ed8f-4311-82f1-752677399d62 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041779 Dec 13 22:56:22.857222 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Dec 13 22:56:22 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:25.284510 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-64926b52-4051-481f-9c1e-0dd679f40928 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:25.285561 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-64926b52-4051-481f-9c1e-0dd679f40928 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Dec 13 22:56:25.286209 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:25.343402 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-037061c1-c34a-4677-84ba-9009b5cdcaf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "name": "ds1G", "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:25.364194 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-037061c1-c34a-4677-84ba-9009b5cdcaf1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071533 Dec 13 22:56:25.371252 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:56:25.377207 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-203299e0-f2b6-49de-92d3-455211519455 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:25.401787 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-203299e0-f2b6-49de-92d3-455211519455 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027947 Dec 13 22:56:25.407813 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Dec 13 22:56:25 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:27.826995 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-037061c1-c34a-4677-84ba-9009b5cdcaf1 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:27.828678 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-037061c1-c34a-4677-84ba-9009b5cdcaf1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Dec 13 22:56:27.829227 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:27.889730 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ed8347ae-adf2-47ec-81cd-f1605aa4de5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:27.908544 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ed8347ae-adf2-47ec-81cd-f1605aa4de5c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072748 Dec 13 22:56:27.909130 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 22:56:27.922024 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-856b2d4b-0980-4fb5-b96b-3115a440ce8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:27.947924 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-856b2d4b-0980-4fb5-b96b-3115a440ce8a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029521 Dec 13 22:56:27.948544 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Dec 13 22:56:27 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:30.347766 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ed8347ae-adf2-47ec-81cd-f1605aa4de5c admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:30.348760 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ed8347ae-adf2-47ec-81cd-f1605aa4de5c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Dec 13 22:56:30.349153 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:30.408639 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-2112c105-fb7a-48ea-83fb-20fbf9c2caeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "swap": 0, "id": "d4", "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:30.430287 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-2112c105-fb7a-48ea-83fb-20fbf9c2caeb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074450 Dec 13 22:56:30.430961 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:30 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 22:56:30.443197 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-6030e706-86d4-47e3-ac64-2f244e3c0618 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:30.467569 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-6030e706-86d4-47e3-ac64-2f244e3c0618 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028048 Dec 13 22:56:30.468141 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Dec 13 22:56:30 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:32.881059 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-2112c105-fb7a-48ea-83fb-20fbf9c2caeb admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:32.882106 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-2112c105-fb7a-48ea-83fb-20fbf9c2caeb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Dec 13 22:56:32.882541 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:32.961171 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-8b616bbb-5342-4d12-8889-2121f91848d5 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:32.984763 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-8b616bbb-5342-4d12-8889-2121f91848d5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.093251 Dec 13 22:56:32.985313 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Dec 13 22:56:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 22:56:35.682155 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-2112c105-fb7a-48ea-83fb-20fbf9c2caeb admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:35.683217 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-2112c105-fb7a-48ea-83fb-20fbf9c2caeb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Dec 13 22:56:35.683649 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:35.748057 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-faf0327c-2bda-4540-8b70-68599199a158 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "ram": 512}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:35.768478 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-faf0327c-2bda-4540-8b70-68599199a158 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077715 Dec 13 22:56:35.769021 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:35 2021] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 22:56:35.782019 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-264d5752-79ce-4a60-b796-6244f65bf198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:35.806496 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-264d5752-79ce-4a60-b796-6244f65bf198 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028203 Dec 13 22:56:35.807251 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Dec 13 22:56:35 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:38.226139 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-faf0327c-2bda-4540-8b70-68599199a158 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:38.227500 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-faf0327c-2bda-4540-8b70-68599199a158 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Dec 13 22:56:38.229885 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:38 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:38.292983 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0e0d5ff5-aca7-4d30-be2c-2a7369deafea admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:38.313269 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0e0d5ff5-aca7-4d30-be2c-2a7369deafea admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076454 Dec 13 22:56:38.313995 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:56:38.326852 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-0a27dcd9-c9d3-44be-a19c-f9374bfd668f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:38.350734 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-0a27dcd9-c9d3-44be-a19c-f9374bfd668f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027869 Dec 13 22:56:38.351448 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Dec 13 22:56:38 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:40.736953 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0e0d5ff5-aca7-4d30-be2c-2a7369deafea admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:40.738532 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0e0d5ff5-aca7-4d30-be2c-2a7369deafea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Dec 13 22:56:40.749535 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:40 2021] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:40.801315 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-611bec79-be31-4bf6-a408-ee23556e18a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:40.820981 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-611bec79-be31-4bf6-a408-ee23556e18a8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074054 Dec 13 22:56:40.821677 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:40 2021] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:56:40.834576 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-68f2b947-837f-49a9-8fdd-00bdc6b0cc88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:40.863734 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-68f2b947-837f-49a9-8fdd-00bdc6b0cc88 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032947 Dec 13 22:56:40.864313 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Dec 13 22:56:40 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 22:56:43.321436 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-611bec79-be31-4bf6-a408-ee23556e18a8 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:43.323089 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-611bec79-be31-4bf6-a408-ee23556e18a8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002295 Dec 13 22:56:43.323669 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:43.391225 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-8f81b685-ebd2-4eb5-ab0b-4ed4d9b1f281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:43.412608 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-8f81b685-ebd2-4eb5-ab0b-4ed4d9b1f281 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082207 Dec 13 22:56:43.413552 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:43 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:56:43.426060 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-9aa4fbdf-a265-4d17-ac36-56982d7711ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:43.451893 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-9aa4fbdf-a265-4d17-ac36-56982d7711ca admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029365 Dec 13 22:56:43.465364 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Dec 13 22:56:43 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:56:45.877696 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-8f81b685-ebd2-4eb5-ab0b-4ed4d9b1f281 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:56:45.878723 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-8f81b685-ebd2-4eb5-ab0b-4ed4d9b1f281 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Dec 13 22:56:45.879136 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:56:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:56:45.940348 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-cec4d942-e83a-43d2-b3f9-9ad25068ae52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:45.961173 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-cec4d942-e83a-43d2-b3f9-9ad25068ae52 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075618 Dec 13 22:56:45.961955 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Dec 13 22:56:45 2021] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 22:56:45.975170 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-87766865-c5ae-41ea-a8ac-f15c8fa5ee80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:56:45.999417 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-87766865-c5ae-41ea-a8ac-f15c8fa5ee80 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027967 Dec 13 22:56:46.000324 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Dec 13 22:56:45 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 22:57:06.710459 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-cec4d942-e83a-43d2-b3f9-9ad25068ae52 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:06.711471 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-cec4d942-e83a-43d2-b3f9-9ad25068ae52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Dec 13 22:57:06.711974 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:57:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:06.783605 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-69829953-5fe4-44e7-9825-1ed20a5d0598 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:06.808595 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-69829953-5fe4-44e7-9825-1ed20a5d0598 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.086187 Dec 13 22:57:06.809137 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Dec 13 22:57:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:57:08.432463 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-cec4d942-e83a-43d2-b3f9-9ad25068ae52 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:08.433852 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-cec4d942-e83a-43d2-b3f9-9ad25068ae52 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002412 Dec 13 22:57:08.434406 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:08.642056 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-eba49b92-ba4b-4dc2-9ce1-3cd2f48e468d admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:08.648500 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.wsgi [None req-eba49b92-ba4b-4dc2-9ce1-3cd2f48e468d admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 13 22:57:08.649118 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-eba49b92-ba4b-4dc2-9ce1-3cd2f48e468d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 22:57:08.649947 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-eba49b92-ba4b-4dc2-9ce1-3cd2f48e468d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.076785 Dec 13 22:57:08.650482 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Dec 13 22:57:08 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 22:57:08.661685 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-0d9f6f54-5a80-4980-8085-316038df4869 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:08.683061 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-0d9f6f54-5a80-4980-8085-316038df4869 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025675 Dec 13 22:57:08.683737 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Dec 13 22:57:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:57:08.694551 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-dc83ec05-d0ad-4e3c-965f-8f72677ba084 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:08.715993 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-dc83ec05-d0ad-4e3c-965f-8f72677ba084 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025075 Dec 13 22:57:08.716529 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Dec 13 22:57:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:57:08.726659 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-a2d79dcd-6d39-46bd-93a9-0a2e77ba752d admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:08.732578 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-a2d79dcd-6d39-46bd-93a9-0a2e77ba752d admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 13 22:57:08.733144 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-a2d79dcd-6d39-46bd-93a9-0a2e77ba752d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 22:57:08.733972 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-a2d79dcd-6d39-46bd-93a9-0a2e77ba752d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011002 Dec 13 22:57:08.734488 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Dec 13 22:57:08 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 22:57:10.251392 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-dc83ec05-d0ad-4e3c-965f-8f72677ba084 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:10.252409 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-dc83ec05-d0ad-4e3c-965f-8f72677ba084 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 13 22:57:10.252804 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:10.464055 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-8dca5e6d-7474-4702-a1ca-eb3013840812 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:10.470586 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-8dca5e6d-7474-4702-a1ca-eb3013840812 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 13 22:57:10.471176 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-8dca5e6d-7474-4702-a1ca-eb3013840812 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 22:57:10.471975 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-8dca5e6d-7474-4702-a1ca-eb3013840812 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.073821 Dec 13 22:57:10.472490 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Dec 13 22:57:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 22:57:10.483034 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-40413555-f790-474a-8318-141b338cb875 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:10.498805 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-40413555-f790-474a-8318-141b338cb875 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019446 Dec 13 22:57:10.499328 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Dec 13 22:57:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:57:10.509555 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-f4c45c7f-6631-42fc-b628-affb2e7aeff8 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:10.523668 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-f4c45c7f-6631-42fc-b628-affb2e7aeff8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017867 Dec 13 22:57:10.524608 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Dec 13 22:57:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:57:10.541863 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-76a0c27c-0586-4b1a-aae3-8a7bd96c3eb3 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:10.551387 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.wsgi [None req-76a0c27c-0586-4b1a-aae3-8a7bd96c3eb3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 13 22:57:10.552265 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-76a0c27c-0586-4b1a-aae3-8a7bd96c3eb3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 22:57:10.553984 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-76a0c27c-0586-4b1a-aae3-8a7bd96c3eb3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017878 Dec 13 22:57:10.554700 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Dec 13 22:57:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 22:57:12.030521 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-f4c45c7f-6631-42fc-b628-affb2e7aeff8 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:12.031816 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-f4c45c7f-6631-42fc-b628-affb2e7aeff8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Dec 13 22:57:12.032311 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:12.248933 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-b164ee1e-704f-457a-9e82-ebc627ce831b admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:12.254637 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.wsgi [None req-b164ee1e-704f-457a-9e82-ebc627ce831b admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 13 22:57:12.255199 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-b164ee1e-704f-457a-9e82-ebc627ce831b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 22:57:12.255998 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-b164ee1e-704f-457a-9e82-ebc627ce831b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063725 Dec 13 22:57:12.256507 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Dec 13 22:57:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 22:57:12.266768 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-c9fca495-7584-47e0-a423-5b658d733f4d admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:12.281515 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-c9fca495-7584-47e0-a423-5b658d733f4d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018343 Dec 13 22:57:12.282118 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Dec 13 22:57:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:57:12.296570 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:12.310892 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019488 Dec 13 22:57:12.311432 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Dec 13 22:57:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:57:12.322042 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-48f7c432-cf99-42b9-ac6d-ea419f276e2d admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:12.328070 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-48f7c432-cf99-42b9-ac6d-ea419f276e2d admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 13 22:57:12.328628 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-48f7c432-cf99-42b9-ac6d-ea419f276e2d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 22:57:12.329433 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-48f7c432-cf99-42b9-ac6d-ea419f276e2d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011321 Dec 13 22:57:12.329927 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Dec 13 22:57:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 22:57:13.839489 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:13.840485 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Dec 13 22:57:13.840883 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:14.053637 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-12b61060-c6e7-410f-8385-5936ec4bb2a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:57:14.074716 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-12b61060-c6e7-410f-8385-5936ec4bb2a6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086914 Dec 13 22:57:14.075257 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Dec 13 22:57:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:57:15.584055 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:15.585050 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Dec 13 22:57:15.585514 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:15.780114 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-637c7725-89df-4445-bbe4-5e3cf9b0b7f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:57:15.800286 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-637c7725-89df-4445-bbe4-5e3cf9b0b7f2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075970 Dec 13 22:57:15.800770 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Dec 13 22:57:15 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:57:17.304639 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:17.305892 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Dec 13 22:57:17.306302 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:17.513597 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-94dd9302-bc4c-4548-83eb-7d93229e4a2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:57:17.535402 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-94dd9302-bc4c-4548-83eb-7d93229e4a2c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.087970 Dec 13 22:57:17.535949 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Dec 13 22:57:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:57:19.049995 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:19.051328 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Dec 13 22:57:19.051779 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:19.259590 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-137074a2-1d95-405b-8608-64a68f510997 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 22:57:19.279562 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-137074a2-1d95-405b-8608-64a68f510997 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084252 Dec 13 22:57:19.280134 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Dec 13 22:57:19 2021] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 22:57:20.795789 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:20.797354 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 Dec 13 22:57:20.797920 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 22:57:20 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:57:21.003597 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-039f3b40-9933-4d2e-855c-51a64144123a admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:57:21.022681 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-039f3b40-9933-4d2e-855c-51a64144123a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.082594 Dec 13 22:57:21.023190 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon Dec 13 22:57:20 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:58:09.079309 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:58:09.080730 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ae4ff4ee-3595-4e9f-9053-9ba0cc121b25 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002376 Dec 13 22:58:09.081136 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 930 bytes} [Mon Dec 13 22:58:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 22:58:09.153377 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-61496f81-87de-4c75-b84c-6e6a495eb47d admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:58:09.176768 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-61496f81-87de-4c75-b84c-6e6a495eb47d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.085298 Dec 13 22:58:09.177306 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Dec 13 22:58:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 22:58:09.200011 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-6484b779-375c-4725-8c6a-2991b6cda6a8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:58:09.208197 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-6484b779-375c-4725-8c6a-2991b6cda6a8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012256 Dec 13 22:58:09.208825 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Dec 13 22:58:09 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:58:09.221665 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-82442e96-7298-476e-a8e2-0f22c18d9de2 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:58:09.229764 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-82442e96-7298-476e-a8e2-0f22c18d9de2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011575 Dec 13 22:58:09.230341 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Dec 13 22:58:09 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:58:09.245155 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-17690f82-dc86-4c9b-8a25-9e2081fa5330 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:58:09.256978 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-17690f82-dc86-4c9b-8a25-9e2081fa5330 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017189 Dec 13 22:58:09.257832 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Dec 13 22:58:09 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:58:09.271369 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:58:09.279517 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011609 Dec 13 22:58:09.280029 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Dec 13 22:58:09 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 22:59:33.140207 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-dbdc122a-767d-4a30-8a30-2052655e049f tempest-verify_tempest_config-619696100 tempest-verify_tempest_config-619696100-project] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 22:59:33.143275 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-dbdc122a-767d-4a30-8a30-2052655e049f tempest-verify_tempest_config-619696100 tempest-verify_tempest_config-619696100-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.127543 Dec 13 22:59:33.144029 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 35/69] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Dec 13 22:59:33 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:00:59.789428 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:00:59.790464 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Dec 13 23:00:59.790865 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 23:00:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:01:00.070273 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-5e90039a-7335-4789-86a4-a3fcffdfd9d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:01:00.071575 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:01:00.071575 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Dec 13 23:01:00.073129 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-5e90039a-7335-4789-86a4-a3fcffdfd9d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:00.073606 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-5e90039a-7335-4789-86a4-a3fcffdfd9d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:00.074433 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-5e90039a-7335-4789-86a4-a3fcffdfd9d8 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:00.074856 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-5e90039a-7335-4789-86a4-a3fcffdfd9d8 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:00.108153 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-5e90039a-7335-4789-86a4-a3fcffdfd9d8 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.172220 Dec 13 23:01:00.108714 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 36/71] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Dec 13 23:00:59 2021] GET /compute/v2.1/os-services => generated 794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:01:01.660334 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:01:01.662204 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Dec 13 23:01:01.662681 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 23:01:01 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:01:01.868641 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-286b2e2f-df5a-46cc-8833-5497d50dabf4 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:01:01.869837 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:01:01.869837 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Dec 13 23:01:01.871373 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-286b2e2f-df5a-46cc-8833-5497d50dabf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:01.871818 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-286b2e2f-df5a-46cc-8833-5497d50dabf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:01.872612 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-286b2e2f-df5a-46cc-8833-5497d50dabf4 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:01.873032 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-286b2e2f-df5a-46cc-8833-5497d50dabf4 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:01.897429 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-286b2e2f-df5a-46cc-8833-5497d50dabf4 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.093238 Dec 13 23:01:01.897981 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 37/73] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Dec 13 23:01:01 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:01:13.847970 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:01:13.848966 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Dec 13 23:01:13.849345 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 23:01:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:01:14.045940 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-61dabaeb-8015-4a7c-80ac-0a3d4598b025 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:01:14.047893 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:01:14.047893 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Dec 13 23:01:14.050309 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-61dabaeb-8015-4a7c-80ac-0a3d4598b025 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:14.050878 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-61dabaeb-8015-4a7c-80ac-0a3d4598b025 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:14.052071 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-61dabaeb-8015-4a7c-80ac-0a3d4598b025 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:14.052664 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-61dabaeb-8015-4a7c-80ac-0a3d4598b025 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:14.077537 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-61dabaeb-8015-4a7c-80ac-0a3d4598b025 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087549 Dec 13 23:01:14.078053 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 38/75] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Dec 13 23:01:13 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:01:15.598108 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:01:15.599725 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-22601055-74de-4a51-aa27-545c11399a83 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002310 Dec 13 23:01:15.600384 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Dec 13 23:01:15 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:01:15.807079 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-7cda5e87-8a19-4430-9338-a637cae31745 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:01:15.808239 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:01:15.808239 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Dec 13 23:01:15.809862 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7cda5e87-8a19-4430-9338-a637cae31745 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:15.810296 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7cda5e87-8a19-4430-9338-a637cae31745 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:15.811094 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7cda5e87-8a19-4430-9338-a637cae31745 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:01:15.811547 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-7cda5e87-8a19-4430-9338-a637cae31745 admin admin] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:01:15.832588 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-7cda5e87-8a19-4430-9338-a637cae31745 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.089669 Dec 13 23:01:15.833125 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 39/77] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Dec 13 23:01:15 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:02:13.094217 dv-cinder-796286-23-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 13 23:02:13.096201 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: Mon Dec 13 23:02:13 2021 - graceful shutdown triggered... Dec 13 23:02:13.096638 dv-cinder-796286-23-iscsi devstack@n-api.service[101865]: Gracefully killing worker 2 (pid: 101865)... Dec 13 23:02:13.097037 dv-cinder-796286-23-iscsi devstack@n-api.service[101864]: Gracefully killing worker 1 (pid: 101864)... Dec 13 23:02:14.097191 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: worker 1 buried after 1 seconds Dec 13 23:02:14.097966 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: worker 2 buried after 1 seconds Dec 13 23:02:14.097966 dv-cinder-796286-23-iscsi devstack@n-api.service[101863]: goodbye to uWSGI. Dec 13 23:02:14.099826 dv-cinder-796286-23-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 13 23:02:14.100776 dv-cinder-796286-23-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 13 23:02:14.105307 dv-cinder-796286-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 13 23:02:14.120163 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 13 23:02:14 2021] *** Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: nodename: dv-cinder-796286-23-iscsi Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: machine: x86_64 Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: clock source: unix Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: pcre jit disabled Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: detected number of CPU cores: 4 Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: current working directory: / Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: detected binary path: /usr/bin/uwsgi-core Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: your processes number limit is 47680 Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: your memory page size is 4096 bytes Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: detected max file descriptor number: 2048 Dec 13 23:02:14.123071 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: lock engine: pthread robust mutexes Dec 13 23:02:14.123995 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: thunder lock: enabled Dec 13 23:02:14.123995 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 13 23:02:14.123995 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 13 23:02:14.168221 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: Python main interpreter initialized at 0x5632f213c9c0 Dec 13 23:02:14.168221 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: python threads support enabled Dec 13 23:02:14.168221 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: your server socket listen backlog is limited to 100 connections Dec 13 23:02:14.168221 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: your mercy for graceful operations on workers is 90 seconds Dec 13 23:02:14.168698 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: mapped 403077 bytes (393 KB) for 2 cores Dec 13 23:02:14.168698 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: *** Operational MODE: preforking *** Dec 13 23:02:14.168965 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: *** uWSGI is running in multiple interpreter mode *** Dec 13 23:02:14.168965 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: spawned uWSGI master process (pid: 116207) Dec 13 23:02:14.169165 dv-cinder-796286-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 13 23:02:14.170366 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: spawned uWSGI worker 1 (pid: 116225, cores: 1) Dec 13 23:02:14.170366 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: spawned uWSGI worker 2 (pid: 116226, cores: 1) Dec 13 23:02:14.170366 dv-cinder-796286-23-iscsi devstack@n-api.service[116207]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 13 23:02:16.091337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 23:02:16.091337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: from cryptography.utils import int_from_bytes Dec 13 23:02:16.092087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 23:02:16.092087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: from cryptography.utils import int_from_bytes Dec 13 23:02:16.094633 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 23:02:16.094633 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: from cryptography.utils import int_from_bytes Dec 13 23:02:16.095184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 23:02:16.095184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: from cryptography.utils import int_from_bytes Dec 13 23:02:18.535228 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 23:02:18.535922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 23:02:18.535922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 23:02:18.536404 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 23:02:18.536510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 23:02:18.536832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.537166 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.537559 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.537883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.538218 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.538534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.538829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.539183 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.539483 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.539749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.540070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.540428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796286-23-iscsi {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.540749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.541088 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.541397 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.541770 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.542052 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.542374 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.542686 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.543196 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.544560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.544560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.544560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.544945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.545174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.545545 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.545846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.546184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.546495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.546814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.547217 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796286-23-iscsi {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.547539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.547875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.548181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.548591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.548910 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.549226 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.549664 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.549974 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.550290 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.550621 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.550949 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.551273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.551601 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.551932 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.552217 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.552886 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.553244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.553600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.553893 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.554145 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.554460 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.554788 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.555072 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 23:02:18.555619 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.555768 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 23:02:18.555918 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.555918 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.556220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 23:02:18.556375 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.556574 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 23:02:18.556805 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.557043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 23:02:18.557203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.557550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.557718 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.557860 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.558021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.558165 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.558312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.558478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.558663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.558805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.558967 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.559120 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.559270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.559416 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.559572 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.559738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.559885 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.560046 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.560197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.560369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.560510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.560653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.560810 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.560962 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796286-23-iscsi {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.561117 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.561257 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.561459 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.561602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.561756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.561905 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.562060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.562288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.562442 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.562598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.562748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.562894 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.563047 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.563191 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.563330 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.563478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.563642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.563791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.563941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.564844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.565011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.565152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.565297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.565486 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.565634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.565783 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.565938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.566084 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.566228 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.566376 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.566525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.566664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.566819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.566964 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.567121 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.567267 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.567417 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.567417 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.567694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796286-23-iscsi {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.567841 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.567990 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.568130 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.568268 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.568410 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.568554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.568727 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.568881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.569031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.569172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.569311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.569528 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.569671 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.569809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.569946 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.570083 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.570221 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.570367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.570524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.570672 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.570818 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.570971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.571195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.571347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.571493 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.571632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.571769 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.571915 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.572070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.572255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.572396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.572597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.572748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.572895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.573044 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.573183 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.573323 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.573509 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.573659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.573797 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.573941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.574080 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.574248 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.575141 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.575304 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.575451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.575591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.575728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.575892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.576036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.576036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.576315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.576454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.576600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.576752 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.576911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.577057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.577197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.579853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.580056 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.580401 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.580565 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.580711 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.580861 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.581008 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.581164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.581312 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.581562 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.582341 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.582504 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.582645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.582799 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.582950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.583098 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.583244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.583384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.583530 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.583684 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.583831 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.583977 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.584116 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.584273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.584273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.584599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.584599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.585614 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.585766 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.585925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.586079 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.586227 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.586374 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.586522 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.586831 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.586985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.587153 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.587349 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.587493 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.587642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.587805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.587986 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.588138 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.588286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.588441 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.588586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.588806 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.588958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.589125 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.589266 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.589470 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.589623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.589771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.589924 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.590071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.590211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.590356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.590505 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.590649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.590800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.590946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.591095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.591234 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.591372 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.591520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.591672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.591818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.591963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.592107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.592246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.592383 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.592529 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.592675 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.592850 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.593009 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.593149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.593300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.593463 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.593616 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.593616 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.593886 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.594031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.594384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.594384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.594662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.594808 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.595627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.595883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.596044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.596220 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.596370 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.596519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.596665 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.596814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.596967 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.597108 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.597245 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.597424 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.597600 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.597875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.598029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.598177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.598328 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.598476 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.598624 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.598778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.598923 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.599063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.599215 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.599361 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.599500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.599500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.599790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.599938 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.600092 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.600237 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.600377 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.600514 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.600653 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.600798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.600954 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.601183 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.601325 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.601500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.601650 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.601811 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.601967 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.602120 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.602259 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.602397 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.602541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.602688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.602836 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.602984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.603124 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.603262 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.603436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.603592 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.603741 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.603890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.604031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.604168 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.604313 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.604466 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.604607 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.604745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.604891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.605037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.605883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.606142 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.606300 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.606439 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 23:02:18.606586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.606735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.606882 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.607035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.607175 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.607314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.607452 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.607601 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.607748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.607913 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.608132 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.608295 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.608443 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.608582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.608735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.608875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.609014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.609152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.609289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.609448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.609605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.609753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.609892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.610048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.610194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.610333 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.610483 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.610630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.610777 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.610922 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.611068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.611218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.611372 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.611518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.611656 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.611802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.611950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.612097 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.612244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.612390 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.612541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.612681 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.612827 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.612980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.613120 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.613269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.613475 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.613616 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.613754 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.613754 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.614058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.614199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.614337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.614482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.614621 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.614778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.614919 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.615066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.615204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.615443 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.616041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.616295 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.616451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.616592 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.616730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.616875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.617028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.617177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.617316 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.617495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.617642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.617782 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.617933 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.618073 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.618311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.618481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.618747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.618892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.619102 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.619305 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.619672 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.619816 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.620187 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.620780 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.620948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.620948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.621224 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.621414 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.621568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.621725 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.621866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.622014 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.622161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.622323 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.623361 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.623525 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.623670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.623810 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.623958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.624098 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.624256 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.624409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.624560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.624700 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.624845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.624984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.625135 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.625274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.625453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.625697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.626266 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.626519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.626684 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.626844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.626985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.627123 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.627268 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.627407 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.627697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.627857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.627998 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.628136 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.628298 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.628520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.628675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.628918 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.629065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.629204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.629392 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.629539 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.629691 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.629831 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.629982 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.630121 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.630259 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.630489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.630639 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.630787 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.630944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.631095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.631095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.631382 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.631522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.631660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.631805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.631944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.632087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.632240 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.632386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.632525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.632670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.632820 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.632958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.633105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.633244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.633410 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.633563 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.633711 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.633859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.633999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.634136 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.634274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.634410 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.634557 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.634742 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.634892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.635031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.635177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.635329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.635469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.635615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.636011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.636398 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.636710 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.636868 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637017 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637183 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637325 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637525 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637966 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.637966 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.638229 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.638229 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.638229 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.638717 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.638885 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.639097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.639258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.639409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.639549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.639549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.639833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.639980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.640119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.640263 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.640401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.640546 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.640546 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.640827 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.640973 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.641121 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.641266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.641438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.641587 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.641726 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.641872 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.642018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.642156 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.642302 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.642441 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.642579 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.642716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.642861 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.643010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.643162 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.643310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.643449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.643587 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.643734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.643880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.644036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.644174 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.644312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.644449 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.644595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.644744 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.644894 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.645031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.645176 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.645322 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.645322 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.645705 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.645881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.645881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.647414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.647582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.647820 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.647993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.648151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.648291 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.648438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.648577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.648734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.648955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.649124 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.649381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.649541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.649689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.649835 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.649989 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.650130 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.650322 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.650478 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.650625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.650774 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.650914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651536 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651690 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.651971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.652245 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.652398 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.652548 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.652722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.652911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.653057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.653195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.653369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.653532 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.653680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.653832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.653985 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.654142 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.654302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.654448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.654592 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.654736 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.654918 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.655154 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.655314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.655461 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.655614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.655768 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.655921 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.656067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.656614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.656904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.657056 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.657305 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.658013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.658182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.658347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.658564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.658712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.658857 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.659085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.659247 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.659485 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.659650 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.659804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.659964 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.660112 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.660265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.660413 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.660557 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.660718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.660955 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.661105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.661250 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.661461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.661613 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.661783 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.661939 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.662085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.662230 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.662387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.662534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.662700 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.662847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.662993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.663137 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.663281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.663432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.663589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.663760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.663907 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.663907 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.664180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.664325 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.664482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.664637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.664791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.664936 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.665143 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.665303 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.665475 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.665635 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.665791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.665980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.666130 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.666283 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.666787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.667041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.667194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.667368 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.667613 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.667777 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.667925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.668115 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.668277 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.668422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.668565 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.668718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.668873 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.668873 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.669231 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.669463 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.669694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.669857 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.670004 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.670149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.670294 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.670449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.670609 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.670764 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.670918 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.671071 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.671225 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.671371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.671525 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.671679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.671833 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.671980 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.672133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.672279 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.672442 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.672598 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.672745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.672896 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673217 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673392 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673543 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.673997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.674308 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.674455 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.674608 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.674763 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.674916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.675076 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.675233 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.675379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.675524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.675668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.675820 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.675990 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.676139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.676294 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.676458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.676948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.677211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.677415 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.678038 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.678201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.678201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.678491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.678645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.678792 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.679894 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.680061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.680210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.680357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.680511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.680659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.681066 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.681217 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.681402 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.681696 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.681896 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.682052 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.682194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.682349 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.682465 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.682614 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.682754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.682880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683284 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683447 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683573 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683848 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.683983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.684106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.684106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.684106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.684434 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.684557 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.684722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.684869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685005 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685121 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685229 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685361 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685843 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.685980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.686486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.686629 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.686629 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.687457 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.687629 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.687787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.687922 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.688090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.688337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.688465 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.688588 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.688719 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.688852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.688984 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.689107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.689229 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.689367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.689492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.689643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.689861 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.690083 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.690218 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.690343 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.690554 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.690680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.690680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.690680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691039 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691170 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691427 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691813 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.691936 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.692067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.692191 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.692321 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.692445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.692802 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.692947 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.693082 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.693207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.693370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.693496 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.693496 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.693751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.693883 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.694180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.694954 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695148 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695242 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695425 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695639 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695737 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695836 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.695929 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696097 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696264 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696354 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696441 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696522 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696782 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.696889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.697384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.697484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.697484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.697484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.697881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.697975 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.697975 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698276 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698385 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698733 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698733 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698897 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.698981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699076 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699159 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699159 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699324 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699407 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699407 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699648 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699648 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699834 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699928 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.699928 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700277 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700550 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.700971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.701520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.701520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.701704 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.701787 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.701787 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.701946 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702125 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702216 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702216 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702709 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.702936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703112 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703193 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703272 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703352 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703525 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703608 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703785 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703867 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.703947 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704391 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704574 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.704989 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705088 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705243 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705344 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705430 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705510 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705693 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705776 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.705952 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706300 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706467 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706560 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706650 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706828 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706910 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.706991 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707083 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707198 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707424 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707529 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707695 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707885 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.707968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708131 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708131 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708600 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708680 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708680 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.708844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709009 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709098 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709594 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.709950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710186 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710595 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710770 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.710949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711040 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711126 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711308 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711399 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711646 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711731 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.711909 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712090 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712175 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712256 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712337 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712427 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712600 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712688 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.712688 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713132 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713319 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713515 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.713934 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714094 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714183 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714273 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.714943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715120 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715203 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715294 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715377 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715513 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715603 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715692 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.715784 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.716009 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.716099 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.716335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.716432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.716642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.716744 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.716967 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.717072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.717281 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.717596 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.717699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.717835 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.717925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.718951 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719126 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719356 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719434 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719583 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719740 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719889 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.719957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.720031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.720277 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.720377 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.720579 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.720661 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.720898 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.721019 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.721227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.721321 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.721579 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.721670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.721897 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.722209 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.722566 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.722881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.723109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.723208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.723485 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.723576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.723831 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.723923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.724161 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.724250 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.724480 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.724569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.724812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.724901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.725122 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.725216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.725461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.725609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.725780 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.725888 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.726096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.726194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.726406 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.726502 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.726724 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.726826 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.727021 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.727129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.727346 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.727441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.727747 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.727853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.728067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.728159 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.728415 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.728679 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.728998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.729098 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.729324 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.729439 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.729661 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.729824 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.729969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.730068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.730275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.730364 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.730581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.730688 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.730925 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.731020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.731232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.731333 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.731552 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.731643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.731872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.731977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.732192 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.732302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.732515 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.732605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.732827 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.732927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.733153 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.733247 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.733497 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.733591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.733814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.733905 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.734130 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.734229 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.734453 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.734553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.734762 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.734853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.735079 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.735395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.735523 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.735705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.735856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.736022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.736173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.736340 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.736496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.736670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.736816 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.737135 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.737247 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.737481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.737575 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.737871 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.737978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.738123 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.738233 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.738444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.738544 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.738763 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.738855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.739077 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.739180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.739391 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.739482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.739706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.739803 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.740018 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.740125 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.740331 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.740420 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.740660 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.740766 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.740977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.741092 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.741297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.741416 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.741641 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.741732 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.741958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.742162 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.742268 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.742491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.742582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.742828 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.742928 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.743218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.743495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.743586 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.743832 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.743936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.744228 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.744330 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.744544 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.744642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.744858 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.744957 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.745169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.745270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.745526 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.745619 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.745839 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.745930 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.746153 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.746249 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.746462 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.746554 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.746776 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.746888 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.747081 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.747393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.747715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748250 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748341 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748465 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748655 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748792 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.748966 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.749279 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.749391 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.749710 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.749800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.750036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.750130 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.750369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.750461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.750701 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.750806 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.751026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.751128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.751339 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.751432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.751655 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.751745 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.751969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.752067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.752273 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.752406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.752576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.752678 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.752887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.752979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.753195 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.753294 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.753521 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.753624 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.753839 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.753936 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.754147 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.754244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.754449 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.754642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.754760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.754852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.755060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.755152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.755394 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.755586 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.755717 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.755933 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.756026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.756252 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.756357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.756577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.756676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.756900 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.756998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.757211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.757312 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.757540 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.757634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.757846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.757949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.758230 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.758340 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.758441 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.758527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.758753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.758854 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.759054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.759158 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.759353 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.759451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.759689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.759813 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.760001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.760102 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.760324 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.760421 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.760625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.760725 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.760935 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.761036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.761238 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.761357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.761588 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.761680 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.761890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.761983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.762192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.762301 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.762494 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.762585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.762803 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.762904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.763105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.763233 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.763409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.763557 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.763712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.764012 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.764119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.764318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.764473 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.764618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.764801 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.764922 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.765149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.765242 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.765542 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.765656 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.765846 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.765941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.766155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.766245 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.766453 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.766558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.766771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.766863 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.767071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.767163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.767368 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.767461 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.767678 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.767778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.767987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.768087 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.768385 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.768482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.768601 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.768694 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.768909 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.769002 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.769227 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.769320 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.769570 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.769662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.769894 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.770131 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.770234 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.770506 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.770607 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.770826 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.770918 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.771165 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.771255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.771486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.771577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.771795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.771885 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.772101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.772201 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.772405 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.772676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.772775 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.772995 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.773106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.773316 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.773469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.773648 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.773741 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.773956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.774056 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.774265 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.774358 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.774575 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.774690 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.774882 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.775010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.775189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.775398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.775566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.775877 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.775982 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.776220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.776322 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.776536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.776628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.776852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.776945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.777166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.777260 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.777505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.777611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.777813 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.777908 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.778119 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.778210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.778432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.778618 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.778722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.778959 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.779059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.779294 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.779395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.779609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.779703 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.779914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.780005 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.780331 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.780574 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.780680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.780904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.781020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.781246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.781367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.781585 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.781686 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.781897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.781997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.782216 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.782309 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.782524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.782626 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.782842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.782938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.783152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.783252 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.783476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.783577 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.783812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.783905 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.784136 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.784233 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.784454 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.784547 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.784754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.784842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.785054 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.785148 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.785436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.785538 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.785688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.785789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.786014 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.786119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.786326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.786418 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.786643 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.786735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.786959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.787063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.787267 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.787360 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.787586 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.787676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.787893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.787995 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.788211 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.788317 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.788540 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.788627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.788824 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.788925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.789129 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.789229 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.789482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.789576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.789791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.789890 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.790101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.790195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.790412 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.790511 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.790722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.790824 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.791067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.791161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.791374 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.791698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.791858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.792020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.792203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.792322 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.792546 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.792646 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.792884 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.792976 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.793223 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.793327 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.793576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.793681 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.793886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.793979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.794213 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.794311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.794522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.794629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.794835 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.794927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.795141 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.795239 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.795448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.795548 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.795729 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 23:02:18.795842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.796074 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.796393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.796713 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.797034 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.797375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.797719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.798029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.798372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.798695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.799004 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.799313 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.799614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 23:02:18.799851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 23:02:18.820487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_db.sqlalchemy.engines [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:18.823041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:18.890067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.context [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6ef68d83-174b-4609-9936-379f3e54427a(cell1) {{(pid=116226) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 23:02:18.894372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:18.895981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:02:18.896131 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.context [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6ef68d83-174b-4609-9936-379f3e54427a(cell1) {{(pid=116225) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 23:02:18.896797 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:18.898757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:02:18.900448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:18.902106 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:02:18.902943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:18.904997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:02:18.911323 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:18.912618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:18.918436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_db.sqlalchemy.engines [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:18.921855 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_db.sqlalchemy.engines [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:19.077898 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_db.sqlalchemy.engines [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:19.091872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_db.sqlalchemy.engines [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 23:02:19.415799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 23:02:19.423220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 23:02:19.430637 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: WARNING keystonemiddleware.auth_token [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 23:02:19.436039 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: WARNING keystonemiddleware.auth_token [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 23:02:19.772557 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 23:02:19.777809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: WARNING keystonemiddleware.auth_token [None req-037233c0-4d8f-449d-a3d7-fe0230f196e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 23:02:19.783207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5632f213c9c0 pid: 116226 (default app) Dec 13 23:02:19.787569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: WARNING keystonemiddleware.auth_token [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 23:02:19.792960 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: WARNING keystonemiddleware.auth_token [None req-5a64d5cf-6215-4b8b-adba-12eb2d46c047 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 23:02:19.798326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5632f213c9c0 pid: 116225 (default app) Dec 13 23:02:55.427814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-529056f5-db07-4c56-97e9-83377020ec07 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Action: 'create', calling method: .version_select at 0x7f039c0b9e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1512540970"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:02:56.271351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1309674875", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "5ce30cd9-e5c6-4350-acc3-d84e067c707b"}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:02:57.347495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] validate_networks() for [('5ce30cd9-e5c6-4350-acc3-d84e067c707b', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:02:57.737676 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-529056f5-db07-4c56-97e9-83377020ec07 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.195992 Dec 13 23:02:57.739303 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1154 bytes} [Mon Dec 13 23:02:53 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 4199 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 13 23:02:57.751527 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2141069f-eadf-4fcf-9628-a5578e461627 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039bf7f9d0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:02:57.873930 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2141069f-eadf-4fcf-9628-a5578e461627 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 200 len: 345 microversion: 2.1 time: 0.126235 Dec 13 23:02:57.874861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:02:57 2021] GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:02:58.272126 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1860981411", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "e25a0760-1b13-4e1d-bcac-3c85e52e485e"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:02:58.504436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] validate_networks() for [('e25a0760-1b13-4e1d-bcac-3c85e52e485e', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:02:59.304019 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:02:59.305035 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:02:59.305674 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:02:59.306494 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:02:59.307629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:02:59.338139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:59.339079 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:02:59.341076 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:59.341932 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:02:59.391337 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Getting quotas for project 0804199575b2425fa1dad0bb783c4554. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:02:59.399466 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Getting quotas for user c506d63c763b40c3bbd2adfb3802433e and project 0804199575b2425fa1dad0bb783c4554. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:02:59.422032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:02:59.425703 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:02:59.620783 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-12a99f28-6c3d-43f4-9a95-c4f812a41924 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.578179 Dec 13 23:02:59.621969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:02:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 4581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:02:59.629423 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a871960e-8a1b-4d7c-8ad9-ddb74ac7292b tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039b6b6820>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:02:59.816155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a871960e-8a1b-4d7c-8ad9-ddb74ac7292b tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 200 len: 346 microversion: 2.1 time: 0.192728 Dec 13 23:02:59.817369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:02:59 2021] GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:02:59.902000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:02:59.902505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:02:59.903388 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:02:59.903919 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:02:59.904428 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:02:59.953128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:59.953627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:02:59.954431 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:02:59.954996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:00.067420 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:03:00.085310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for user 916e287d50864a638d3b1efe692e78e4 and project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:03:00.116362 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:03:00.129259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:03:00.157349 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b488c935-9e50-42a2-b19a-ed7a9f5a2fd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'create', calling method: .version_select at 0x7f039b6d5700>, body: {"keypair": {"name": "tempest-keypair-362271203"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:00.342886 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-b488c935-9e50-42a2-b19a-ed7a9f5a2fd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:03:00.359590 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-b488c935-9e50-42a2-b19a-ed7a9f5a2fd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for user 9aa225c572d14800b77943c1902833b0 and project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:03:00.396751 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7b8b0887-2e60-4c36-bcd1-cd4101b46a28 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420658 Dec 13 23:03:00.397856 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 3/5] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:02:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 2423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 13 23:03:00.408523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c4ebec45-37da-47f1-b00a-fcad1413ee76 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:00.409641 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c4ebec45-37da-47f1-b00a-fcad1413ee76 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:00.701448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c4ebec45-37da-47f1-b00a-fcad1413ee76 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:00.756745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c4ebec45-37da-47f1-b00a-fcad1413ee76 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1215 microversion: 2.1 time: 0.357074 Dec 13 23:03:00.758851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:00 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1215 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:00.774127 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-26f338b0-02af-4d00-9e6c-99c5fc3fc9af tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Action: 'create', calling method: .version_select at 0x7f039bea29d0>, body: {"snapshot": {"volume_id": "667e355d-38c1-4aad-8330-d65b5e7259f1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-798690353"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:00.829858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-b488c935-9e50-42a2-b19a-ed7a9f5a2fd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:03:00.864415 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-b488c935-9e50-42a2-b19a-ed7a9f5a2fd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for user 9aa225c572d14800b77943c1902833b0 and project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:03:00.929750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b488c935-9e50-42a2-b19a-ed7a9f5a2fd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.110800 Dec 13 23:03:00.942775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 3/7] 10.222.0.13 () {62 vars in 1198 bytes} [Mon Dec 13 23:02:59 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1124 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 13 23:03:00.957441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-19e2188b-8ac1-4e54-868f-d10c01e263a7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:00.958080 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-19e2188b-8ac1-4e54-868f-d10c01e263a7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:01.137667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-19e2188b-8ac1-4e54-868f-d10c01e263a7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:01.159777 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-19e2188b-8ac1-4e54-868f-d10c01e263a7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1218 microversion: 2.1 time: 0.216029 Dec 13 23:03:01.163922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:00 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:01.460156 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-26f338b0-02af-4d00-9e6c-99c5fc3fc9af tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.699148 Dec 13 23:03:01.461069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 5/9] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Dec 13 23:03:00 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:01.470362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1675bba8-31c6-4a1b-a964-ed88690fcbe5 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a5ec280>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:01.644616 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1675bba8-31c6-4a1b-a964-ed88690fcbe5 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 200 len: 286 microversion: 2.1 time: 0.177786 Dec 13 23:03:01.645464 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 5/10] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Dec 13 23:03:01 2021] GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:01.655708 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9b444b60-adec-4b8b-b864-80f55afa03bf tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039b648ee0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:01.775776 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9092952f-0e32-434e-8154-d4eef1482313 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:01.776733 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9092952f-0e32-434e-8154-d4eef1482313 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:01.784823 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9b444b60-adec-4b8b-b864-80f55afa03bf tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.133144 Dec 13 23:03:01.785998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Dec 13 23:03:01 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:01.796061 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ee3ec9a0-2bac-4057-b44b-aa4b7d8d2f23 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039b648d30>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:01.870790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ee3ec9a0-2bac-4057-b44b-aa4b7d8d2f23 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 200 len: 286 microversion: 2.1 time: 0.078359 Dec 13 23:03:01.871649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Dec 13 23:03:01 2021] GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:01.928052 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9092952f-0e32-434e-8154-d4eef1482313 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:01.948893 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9092952f-0e32-434e-8154-d4eef1482313 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1215 microversion: 2.1 time: 0.177079 Dec 13 23:03:01.952538 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:01 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:02.188315 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:02.188863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:02.196048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:02.196769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:02.197859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:02.198461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:02.619279 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:02.641891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7b999bab-9ae7-4369-ab90-8bb996b11d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1222 microversion: 2.1 time: 0.464402 Dec 13 23:03:02.642532 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 8/14] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:02 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1222 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:02.882815 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-29917a93-b600-4566-87ec-f06f51a00b98 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a6014c0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:02.938477 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-29917a93-b600-4566-87ec-f06f51a00b98 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 200 len: 286 microversion: 2.1 time: 0.059720 Dec 13 23:03:02.946934 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Dec 13 23:03:02 2021] GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:02.970489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:02.971143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:02.980422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:02.980869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:02.981688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:02.982128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:03.124967 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:03.133475 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-50cfeb53-fb33-424e-89c5-74dbabcbd198 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1219 microversion: 2.1 time: 0.168537 Dec 13 23:03:03.137574 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:02 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:03.659026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:03.659651 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:03.678280 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:03.678733 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:03.679555 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:03.679990 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:03.950773 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3c8cdef-95fb-43f0-8459-d14608f60a29 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039addb1f0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:04.118613 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:04.147865 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-34888fb1-7b26-415f-b118-0fd442a78bca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1222 microversion: 2.1 time: 0.489289 Dec 13 23:03:04.157402 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:03 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1222 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:04.166517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:04.217352 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:04.217640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3c8cdef-95fb-43f0-8459-d14608f60a29 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 200 len: 286 microversion: 2.1 time: 0.228249 Dec 13 23:03:04.217640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 10/18] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Dec 13 23:03:03 2021] GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:04.217833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:04.217833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:04.217833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:04.217833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:04.491519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:04.505801 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8eb9855c-e760-416c-a526-3f089d5a0e9f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1219 microversion: 2.1 time: 0.351469 Dec 13 23:03:04.507036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 9/19] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:04 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1219 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:05.165555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:05.167170 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:05.181505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:05.182602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:05.183789 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:05.184530 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:05.228928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-70c5d9e1-2e0b-4a66-9898-1b5539b96c00 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a583790>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:05.288866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-70c5d9e1-2e0b-4a66-9898-1b5539b96c00 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 200 len: 287 microversion: 2.1 time: 0.086807 Dec 13 23:03:05.301541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 10/20] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Dec 13 23:03:05 2021] GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:05.307831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e52c3abc-eec1-42cf-930e-6b922864429a tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a578820>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:05.434975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e52c3abc-eec1-42cf-930e-6b922864429a tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 202 len: 0 microversion: 2.1 time: 0.131640 Dec 13 23:03:05.438814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Dec 13 23:03:05 2021] DELETE /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:03:05.444456 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-740179fe-076d-4f3d-b4ba-48ef2a24f6f5 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a5973a0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:05.497667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-740179fe-076d-4f3d-b4ba-48ef2a24f6f5 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 200 len: 286 microversion: 2.1 time: 0.057203 Dec 13 23:03:05.498320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 12/22] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Dec 13 23:03:05 2021] GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:03:05.523316 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:05.523943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:05.532851 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:05.533307 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:05.534149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:05.534591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:05.782810 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:05.782992 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:05.796247 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-058e14a9-ffcb-441c-9c13-fcb900cca8b5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1214 microversion: 2.1 time: 0.634536 Dec 13 23:03:05.811859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:05 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1214 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:05.812209 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e4c335ae-86f0-43fc-a016-e47f3c73841b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1211 microversion: 2.1 time: 0.289783 Dec 13 23:03:05.813081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:05 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1211 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:06.198281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2073871174", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a89e1473-8054-486c-b303-1d4dde50db3c"}], "security_groups": [{"name": "tempest-securitygroup--91867104"}], "key_name": "tempest-keypair-362271203", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:06.510278 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-769eb300-e19c-47c6-8adb-2f8edd50e7f6 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a578c10>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:06.563724 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-769eb300-e19c-47c6-8adb-2f8edd50e7f6 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] HTTP exception thrown: Snapshot 966d0dea-1cea-4621-91da-bfd410d02b8e could not be found. Dec 13 23:03:06.564414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-769eb300-e19c-47c6-8adb-2f8edd50e7f6 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Returning 404 to user: Snapshot 966d0dea-1cea-4621-91da-bfd410d02b8e could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:03:06.565495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-769eb300-e19c-47c6-8adb-2f8edd50e7f6 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e" status: 404 len: 111 microversion: 2.1 time: 0.059911 Dec 13 23:03:06.566297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Dec 13 23:03:06 2021] GET /compute/v2.1/os-snapshots/966d0dea-1cea-4621-91da-bfd410d02b8e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 13 23:03:06.576895 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bd7fcb17-193f-4a23-a464-25adf1ccd3f4 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039c90c4c0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:06.588438 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] validate_networks() for [('a89e1473-8054-486c-b303-1d4dde50db3c', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:03:06.783093 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bd7fcb17-193f-4a23-a464-25adf1ccd3f4 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 202 len: 0 microversion: 2.1 time: 0.211380 Dec 13 23:03:06.783903 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 15/26] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Dec 13 23:03:06 2021] DELETE /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:03:06.794843 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2614e450-deac-4964-b19d-04589ce0c45a tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a583f70>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:06.886997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2614e450-deac-4964-b19d-04589ce0c45a tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 200 len: 345 microversion: 2.1 time: 0.098257 Dec 13 23:03:06.887813 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 16/27] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:06 2021] GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:06.893140 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:06.893908 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:06.903840 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:06.904398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:06.905306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:06.905894 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:07.155686 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:07.165167 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d57743e1-9c3d-4cd4-ac98-9be0e4fb2c9f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1276 microversion: 2.1 time: 0.275961 Dec 13 23:03:07.175210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 17/28] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:06 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1276 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:07.186920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:07.188252 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:07.201441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:07.202209 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:07.203186 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:07.203833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:07.356781 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:07.370054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0e24ba63-2362-4207-8138-a36c83533c82 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1273 microversion: 2.1 time: 0.189809 Dec 13 23:03:07.380148 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 18/29] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:07 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:07.900589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bca33465-1608-44da-905c-f151dcab9113 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a59fee0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:07.991751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bca33465-1608-44da-905c-f151dcab9113 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 200 len: 345 microversion: 2.1 time: 0.095521 Dec 13 23:03:07.992324 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 19/30] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:07 2021] GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:03:08.191860 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:08.192485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:08.216173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:08.216876 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:08.218155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:08.218758 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:08.349480 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:08.362101 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5c78d242-f212-496e-9294-1b754134c958 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1276 microversion: 2.1 time: 0.172489 Dec 13 23:03:08.365485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 20/31] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:08 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:08.387177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:08.387832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:08.393755 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:08.394221 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:08.395026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:08.395466 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:08.550835 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:08.559183 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6753c4d3-741a-4788-a3a1-2251e937b652 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1273 microversion: 2.1 time: 0.176099 Dec 13 23:03:08.560639 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 21/32] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:08 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:08.580493 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:03:08.581866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:03:08.582544 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:03:08.583143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:03:08.583738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:03:08.601035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:08.601522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:08.604426 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:08.604876 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:08.631151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:03:08.635638 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for user 9aa225c572d14800b77943c1902833b0 and project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:03:08.650573 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:03:08.653024 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:03:08.734127 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-63394bcc-af0d-4788-aa7d-979319adba79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.540299 Dec 13 23:03:08.735062 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 12/33] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Dec 13 23:03:06 2021] POST /compute/v2.1/servers => generated 400 bytes in 2542 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 13 23:03:08.752731 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5c64e31c-d9a2-4915-8c88-31212f2dab50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:08.753430 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5c64e31c-d9a2-4915-8c88-31212f2dab50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:08.841275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c64e31c-d9a2-4915-8c88-31212f2dab50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:08.847741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c64e31c-d9a2-4915-8c88-31212f2dab50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:08.849276 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c64e31c-d9a2-4915-8c88-31212f2dab50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:08.854769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5c64e31c-d9a2-4915-8c88-31212f2dab50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1281 microversion: 2.20 time: 0.113478 Dec 13 23:03:08.855359 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 13/34] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:08 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:09.007694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-646ffd50-d0e0-4381-ba42-3b554bea1eea tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039ad990d0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:09.080592 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-646ffd50-d0e0-4381-ba42-3b554bea1eea tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 200 len: 345 microversion: 2.1 time: 0.077682 Dec 13 23:03:09.081199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 14/35] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:09 2021] GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:09.118909 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ce99c15f-368f-4c43-b57e-c424f15931bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'create', calling method: .version_select at 0x7f039a583d30>, body: {"keypair": {"name": "tempest-keypair-368039692"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:09.136867 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-ce99c15f-368f-4c43-b57e-c424f15931bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:03:09.142369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-ce99c15f-368f-4c43-b57e-c424f15931bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for user 03d43744f4884b27a0b5144142ca41bd and project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:03:09.379026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:09.381231 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:09.390770 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:09.391914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:09.394904 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:09.395623 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:09.406079 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-ce99c15f-368f-4c43-b57e-c424f15931bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:03:09.412432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-ce99c15f-368f-4c43-b57e-c424f15931bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for user 03d43744f4884b27a0b5144142ca41bd and project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:03:09.435667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ce99c15f-368f-4c43-b57e-c424f15931bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.719363 Dec 13 23:03:09.438859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 22/36] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Dec 13 23:03:08 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:09.581636 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:09.582256 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:09.596289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:09.599747 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:09.601013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:09.608800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:09.885105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:09.913283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-87c40905-18c0-46d3-a2e7-edad2f757f19 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1273 microversion: 2.1 time: 0.336453 Dec 13 23:03:09.920226 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 23/37] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:09 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:09.934684 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:09.940695 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:09.956867 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:09.960214 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:09.961537 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:09.964376 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:09.965678 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:09.969474 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1fa000eb-1f2f-429d-b1fa-0f225085cce0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.593937 Dec 13 23:03:09.970627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 15/38] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:09 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:10.093862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c15f45a2-a580-4c6a-b6c8-324933b48649 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039ad27dc0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:10.189913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:10.201558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:10.206955 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:10.208117 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a072b5e9-c6c2-4c95-a9d4-43b65d9fb62e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1285 microversion: 2.20 time: 0.286559 Dec 13 23:03:10.227758 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 24/39] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:09 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:10.369000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-c15f45a2-a580-4c6a-b6c8-324933b48649 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] HTTP exception thrown: Volume 667e355d-38c1-4aad-8330-d65b5e7259f1 could not be found. Dec 13 23:03:10.369647 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c15f45a2-a580-4c6a-b6c8-324933b48649 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Returning 404 to user: Volume 667e355d-38c1-4aad-8330-d65b5e7259f1 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:03:10.371761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c15f45a2-a580-4c6a-b6c8-324933b48649 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 404 len: 109 microversion: 2.1 time: 0.281792 Dec 13 23:03:10.372617 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 16/40] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:10 2021] GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 109 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:03:10.385796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e5cf6432-c8c4-4fc5-9d98-c9997463fd04 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039a4f5820>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:10.718318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-e5cf6432-c8c4-4fc5-9d98-c9997463fd04 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] HTTP exception thrown: Volume 667e355d-38c1-4aad-8330-d65b5e7259f1 could not be found. Dec 13 23:03:10.718927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e5cf6432-c8c4-4fc5-9d98-c9997463fd04 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Returning 404 to user: Volume 667e355d-38c1-4aad-8330-d65b5e7259f1 could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:03:10.720113 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e5cf6432-c8c4-4fc5-9d98-c9997463fd04 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 404 len: 109 microversion: 2.1 time: 0.339636 Dec 13 23:03:10.720819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 25/41] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Dec 13 23:03:10 2021] DELETE /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 109 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:03:10.732747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d717db98-fe68-43d5-bd75-00f231d50102 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Calling method '.version_select at 0x7f039c90a5e0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:10.825465 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-d717db98-fe68-43d5-bd75-00f231d50102 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] HTTP exception thrown: Volume 667e355d-38c1-4aad-8330-d65b5e7259f1 could not be found. Dec 13 23:03:10.826173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d717db98-fe68-43d5-bd75-00f231d50102 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] Returning 404 to user: Volume 667e355d-38c1-4aad-8330-d65b5e7259f1 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:03:10.829207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d717db98-fe68-43d5-bd75-00f231d50102 tempest-VolumesSnapshotsTestJSON-409204907 tempest-VolumesSnapshotsTestJSON-409204907-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1" status: 404 len: 109 microversion: 2.1 time: 0.103455 Dec 13 23:03:10.832959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 17/42] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:10 2021] GET /compute/v2.1/os-volumes/667e355d-38c1-4aad-8330-d65b5e7259f1 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:03:10.937842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:10.938784 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:10.972460 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:10.973185 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:10.976497 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:10.980744 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:10.989644 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:10.991598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:11.011388 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:11.013172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:11.018035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:11.018500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:11.167572 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:11.187622 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7a00e2bd-8113-49d3-8e4d-da385732aaf9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1273 microversion: 2.1 time: 0.243539 Dec 13 23:03:11.188311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 26/43] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:10 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:11.227968 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:11.231306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:11.245475 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:11.250441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:11.251414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:11.251880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:11.678602 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:11.716413 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:11.719237 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:11.725501 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-80501dbf-d12b-408f-96ec-c6fec1d3ddb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1333 microversion: 2.20 time: 0.502206 Dec 13 23:03:11.746070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 27/44] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:11 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1333 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:03:12.207439 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:12.219388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:12.221303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:12.245519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7b05d76d-e441-4d72-8e60-5cb856dc92fd tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 1.257441 Dec 13 23:03:12.249581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 18/45] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:10 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:12.252910 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:12.254733 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:12.258236 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:12.262221 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:12.701630 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:12.729471 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bb873b31-3638-4a64-9557-6b3b49a97742 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1273 microversion: 2.1 time: 0.527604 Dec 13 23:03:12.734040 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 28/46] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:12 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1273 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:12.753631 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:12.754664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:12.778779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:12.785616 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:12.788719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:12.789675 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:13.264889 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:13.265835 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:13.285041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:13.285538 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:13.286371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:13.286785 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:13.956958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:13.975301 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:13.985233 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:13.986451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-00493c75-a773-41ce-969e-9c54fc1c0a5d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1351 microversion: 2.20 time: 1.237958 Dec 13 23:03:13.987026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 19/47] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:12 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1351 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:14.007628 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:14.008155 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:14.046404 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:14.047019 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:14.047848 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:14.051073 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:14.519893 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:14.527507 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-628df755-bf81-4b8e-bf52-133db7d84e25 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 1.266978 Dec 13 23:03:14.529638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 29/48] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:13 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:14.629156 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:14.637814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a3420694-faaf-4a48-91de-6ea820e01e83 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.643265 Dec 13 23:03:14.638954 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 20/49] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:13 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:15.006563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:15.007218 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:15.016165 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.016669 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.017538 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.017980 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.169216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:15.180809 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:15.182535 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:15.183671 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cc3d97db-8313-4c74-afa4-81371a4c076d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1339 microversion: 2.20 time: 0.181174 Dec 13 23:03:15.193683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 30/50] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:15 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:15.366053 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-6ae76301-649e-479d-9ac5-cc745740b743 req-464b8761-2417-46ef-8355-f40676435933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d21621-3cd9-4755-8588-0e8cb988d280", "tag": "9f7d1643-23b1-4ec2-997f-a41eed0290e7"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:15.370827 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:15.370827 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:03:15.401617 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-6ae76301-649e-479d-9ac5-cc745740b743 req-464b8761-2417-46ef-8355-f40676435933 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.402839 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-6ae76301-649e-479d-9ac5-cc745740b743 req-464b8761-2417-46ef-8355-f40676435933 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.469522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-6ae76301-649e-479d-9ac5-cc745740b743 req-464b8761-2417-46ef-8355-f40676435933 service nova] Creating event network-changed:9f7d1643-23b1-4ec2-997f-a41eed0290e7 for instance 50d21621-3cd9-4755-8588-0e8cb988d280 on hv-cinder-79628 Dec 13 23:03:15.472048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-6ae76301-649e-479d-9ac5-cc745740b743 req-464b8761-2417-46ef-8355-f40676435933 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116226) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 13 23:03:15.475284 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb0acee-6b6c-4863-b0d0-af62e2bda929 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.476649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb0acee-6b6c-4863-b0d0-af62e2bda929 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.480367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb0acee-6b6c-4863-b0d0-af62e2bda929 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.488750 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb0acee-6b6c-4863-b0d0-af62e2bda929 None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.535191 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.compute.rpcapi [None req-ceb0acee-6b6c-4863-b0d0-af62e2bda929 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 13 23:03:15.536189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ceb0acee-6b6c-4863-b0d0-af62e2bda929 None None] Releasing lock "compute-rpcapi-router" {{(pid=116226) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 13 23:03:15.547675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:15.548181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:15.559796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.560507 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.562272 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.564667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.639988 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ceb0acee-6b6c-4863-b0d0-af62e2bda929 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.456005 Dec 13 23:03:15.641897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 21/51] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:15.655581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:15.657647 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:15.674730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.676308 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:15.681515 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:15.682213 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:16.252231 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:16.273226 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-147aa031-56f9-4848-be79-92ec212f5c2d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.617934 Dec 13 23:03:16.276621 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 22/52] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:15 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:16.291631 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:16.292589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:16.309050 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:16.327179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:16.327692 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:16.328526 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:16.328977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:16.347688 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-55193431-85df-4695-9b8a-49b845a0c498 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.804178 Dec 13 23:03:16.363585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 31/53] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:15 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:16.437522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:16.446479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:16.454673 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:16.458309 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1c20ede9-4dae-4291-800c-b4bc0c96f18b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1339 microversion: 2.20 time: 0.178597 Dec 13 23:03:16.458980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 23/54] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:16 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:16.885072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1029686089", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b7619b6-4067-4576-9319-50cca228cd17"}], "security_groups": [{"name": "tempest-securitygroup--516619366"}], "key_name": "tempest-keypair-368039692", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:17.184409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] validate_networks() for [('1b7619b6-4067-4576-9319-50cca228cd17', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:03:17.416604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-fdb6d74b-6603-4059-b95e-702708fd10f0 req-2893a370-6c5c-467d-b67b-fee9dccbc86a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3b7009-1860-4939-a28b-e3d21862277b", "tag": "d64c863f-3d75-442c-ae28-629a3af23ac4"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:17.419226 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:17.419226 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:03:17.435466 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fdb6d74b-6603-4059-b95e-702708fd10f0 req-2893a370-6c5c-467d-b67b-fee9dccbc86a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:17.436203 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fdb6d74b-6603-4059-b95e-702708fd10f0 req-2893a370-6c5c-467d-b67b-fee9dccbc86a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:17.466932 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-fdb6d74b-6603-4059-b95e-702708fd10f0 req-2893a370-6c5c-467d-b67b-fee9dccbc86a service nova] Creating event network-changed:d64c863f-3d75-442c-ae28-629a3af23ac4 for instance 1e3b7009-1860-4939-a28b-e3d21862277b on hv-cinder-79628 Dec 13 23:03:17.476811 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-fdb6d74b-6603-4059-b95e-702708fd10f0 req-2893a370-6c5c-467d-b67b-fee9dccbc86a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.434143 Dec 13 23:03:17.477871 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 24/55] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:17.681030 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2c50263c-b594-4023-ace9-99d833bb6468 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] Action: 'create', calling method: .version_select at 0x7f039ad88f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1408055929", "metadata": {"Type": "work"}}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:17.987988 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:03:17.989144 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:03:17.989854 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:03:17.990476 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:03:17.991118 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:03:18.006619 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.012817 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.017308 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.020161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.064564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:03:18.086584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for user 03d43744f4884b27a0b5144142ca41bd and project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:03:18.112584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:03:18.115153 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:03:18.218651 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4cd7a9ce-0477-49b1-adb5-3bd34bbd422f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.338362 Dec 13 23:03:18.219337 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 32/56] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:03:16 2021] POST /compute/v2.1/servers => generated 401 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:03:18.234306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:18.235458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:18.242967 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.243654 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.245556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.246247 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.299271 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2c50263c-b594-4023-ace9-99d833bb6468 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.819938 Dec 13 23:03:18.301194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 25/57] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Dec 13 23:03:17 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 13 23:03:18.307399 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:18.308360 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:18.322375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.337229 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.338668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.341550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.611637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:18.619719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fbf08374-e3bb-4ef8-ba75-9129015a4cac tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.317302 Dec 13 23:03:18.620250 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 26/58] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:18 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:18.624710 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:18.625345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:18.634665 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:18.635614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.636302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.637250 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:18.637780 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:18.642568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8606fc44-6faf-41b3-9dd8-d2c56e421833 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.422084 Dec 13 23:03:18.652484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 33/59] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:18 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:18.657367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-36064284-ce30-4dd2-91f6-4fa5ead7cace tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:18.657997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-36064284-ce30-4dd2-91f6-4fa5ead7cace tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:18.807433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-36064284-ce30-4dd2-91f6-4fa5ead7cace tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:18.823856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-36064284-ce30-4dd2-91f6-4fa5ead7cace tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1237 microversion: 2.1 time: 0.170097 Dec 13 23:03:18.825189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 34/60] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:18 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1237 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:18.839969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-edf97dc4-1981-4f5d-b745-8e36615a02e0 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] Calling method '.version_select at 0x7f039a578e50>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:18.931715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:18.948347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:18.949984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:18.951221 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-599113f3-b4fc-4486-b8b8-225f060aaea8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.330023 Dec 13 23:03:18.962428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-edf97dc4-1981-4f5d-b745-8e36615a02e0 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc" status: 200 len: 354 microversion: 2.1 time: 0.125140 Dec 13 23:03:18.962899 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 27/61] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:18 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:18.962974 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 35/62] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:18 2021] GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:18.973799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b5d649ad-8fe3-4318-af38-d4103398d9da tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] Calling method '.version_select at 0x7f039acecb80>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:19.055443 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b5d649ad-8fe3-4318-af38-d4103398d9da tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc" status: 200 len: 354 microversion: 2.1 time: 0.092620 Dec 13 23:03:19.056548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 28/63] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:18 2021] GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:19.073192 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8a2cb4b9-828b-4129-90f1-a24cd3841743 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] Calling method '.version_select at 0x7f039a51a280>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:19.170800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8a2cb4b9-828b-4129-90f1-a24cd3841743 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc" status: 202 len: 0 microversion: 2.1 time: 0.101870 Dec 13 23:03:19.171448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 36/64] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Dec 13 23:03:19 2021] DELETE /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:03:19.180339 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-85bb188b-cb8c-4b11-a394-3f9b67e56b88 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] Calling method '.version_select at 0x7f039ad14a60>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:19.259950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-85bb188b-cb8c-4b11-a394-3f9b67e56b88 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc" status: 200 len: 353 microversion: 2.1 time: 0.079391 Dec 13 23:03:19.261567 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 29/65] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:19 2021] GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:19.636160 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:19.636883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:19.647732 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:19.648506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:19.649465 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:19.649946 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:19.659737 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:19.660311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:19.685303 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:19.685787 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:19.686594 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:19.687030 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:19.980461 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:19.989588 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:19.991356 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e5e381f3-bf23-4e7c-aa4e-b2d1b38a5d01 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.358699 Dec 13 23:03:19.996791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 37/66] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:19 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:20.012391 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-766ac03a-ff36-4997-aae4-b7ad0f14f357 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.356426 Dec 13 23:03:20.012977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 30/67] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:19 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:20.019570 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:20.020212 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:20.027490 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:20.028372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:20.037715 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:20.039922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:20.040999 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:20.042142 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:20.042821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:20.043482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:20.044915 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:20.048327 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:20.178955 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:20.187680 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f1f9f252-a9b3-4c89-98d8-b740bae74d7d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1241 microversion: 2.1 time: 0.173322 Dec 13 23:03:20.188603 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 38/68] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:20 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:20.266444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:20.268018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5ad56eec-0a0c-4074-a877-0c866a9e7be7 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] Calling method '.version_select at 0x7f039a5784c0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:20.276740 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:20.279445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:20.281569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b396f5f6-c73e-4ce6-94f2-399394ae7063 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.262743 Dec 13 23:03:20.294763 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 31/69] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:20 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:20.322322 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-5ad56eec-0a0c-4074-a877-0c866a9e7be7 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] HTTP exception thrown: Volume cc88ce2a-d080-44d4-937a-984923c895fc could not be found. Dec 13 23:03:20.323210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5ad56eec-0a0c-4074-a877-0c866a9e7be7 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] Returning 404 to user: Volume cc88ce2a-d080-44d4-937a-984923c895fc could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:03:20.324069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5ad56eec-0a0c-4074-a877-0c866a9e7be7 tempest-VolumesGetTestJSON-1313085550 tempest-VolumesGetTestJSON-1313085550-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc" status: 404 len: 109 microversion: 2.1 time: 0.059991 Dec 13 23:03:20.325305 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 39/70] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:03:20 2021] GET /compute/v2.1/os-volumes/cc88ce2a-d080-44d4-937a-984923c895fc => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 13 23:03:21.014435 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:21.015583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:21.022262 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.022714 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.023496 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.024211 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.030393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:21.031072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:21.040094 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.041262 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.042456 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.043032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.502487 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:21.512370 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6cd46af5-efb2-435a-bf4e-4af2c68ae084 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.503698 Dec 13 23:03:21.513013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 32/71] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:21 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:21.534329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:21.535208 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:21.542849 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.543555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.544557 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.545173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.810057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:21.820286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7db89666-ca63-4035-951e-4ba10d824cdd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1289 microversion: 2.1 time: 0.294047 Dec 13 23:03:21.830816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 33/72] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:21 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1289 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:21.836059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:21.836946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:21.838170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:21.843749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.844545 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.845180 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:21.845729 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:21.848900 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b49ac662-4841-45cc-8d82-d701d2229140 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.822320 Dec 13 23:03:21.849853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 40/73] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:21 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:22.137029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:22.146791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:22.149476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:22.150986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-366a692c-03fe-46d3-8698-5ae13d0bb6f7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.318831 Dec 13 23:03:22.158123 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 34/74] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:21 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:22.515481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-4b2ab2b3-783f-4449-afc4-30324943af6f req-9b33c4e6-b88e-4281-8b50-ee9d83676857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168526af-2c4e-4e84-8b87-7f2e71d96e16", "tag": "ef742767-361d-4046-8bd3-5b8f1c34e632"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:22.518251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:22.518251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:03:22.532243 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-4b2ab2b3-783f-4449-afc4-30324943af6f req-9b33c4e6-b88e-4281-8b50-ee9d83676857 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.532722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-4b2ab2b3-783f-4449-afc4-30324943af6f req-9b33c4e6-b88e-4281-8b50-ee9d83676857 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.534185 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:22.535019 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:22.551893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.553000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.554852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.555994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.561010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-4b2ab2b3-783f-4449-afc4-30324943af6f req-9b33c4e6-b88e-4281-8b50-ee9d83676857 service nova] Creating event network-changed:ef742767-361d-4046-8bd3-5b8f1c34e632 for instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 on hv-cinder-79628 Dec 13 23:03:22.563046 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-4b2ab2b3-783f-4449-afc4-30324943af6f req-9b33c4e6-b88e-4281-8b50-ee9d83676857 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116225) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 13 23:03:22.564379 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b5be7e9-c941-427f-8221-892102de7b6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.572011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b5be7e9-c941-427f-8221-892102de7b6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.573137 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b5be7e9-c941-427f-8221-892102de7b6b None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.573765 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b5be7e9-c941-427f-8221-892102de7b6b None None] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.591309 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.compute.rpcapi [None req-2b5be7e9-c941-427f-8221-892102de7b6b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 13 23:03:22.596486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b5be7e9-c941-427f-8221-892102de7b6b None None] Releasing lock "compute-rpcapi-router" {{(pid=116225) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 13 23:03:22.644552 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2b5be7e9-c941-427f-8221-892102de7b6b None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133413 Dec 13 23:03:22.645383 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 41/75] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:22.731061 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:22.739575 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-35c1b5a4-e8ad-4433-85f0-952ad936161e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.213116 Dec 13 23:03:22.740176 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 35/76] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:22 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:22.838907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:22.839609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:22.846849 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.847479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.848275 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.848705 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.869759 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:22.870876 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:22.878735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.879159 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.880306 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:22.880984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:22.949750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:22.963208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ba7e02c8-cc4e-44c3-9081-a814e204a5aa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1289 microversion: 2.1 time: 0.127935 Dec 13 23:03:22.976140 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 42/77] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:22 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1289 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:23.141023 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:23.150772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ba98d09-6b31-4399-a454-7d574aade413 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.285133 Dec 13 23:03:23.151361 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 36/78] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:22 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:23.176825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:23.179426 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:23.189484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:23.191388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:23.192520 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:23.196161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:23.373399 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:23.381752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:23.383513 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:23.384852 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-54a53961-14e2-48f5-a8cf-ee77e3b3a505 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.212654 Dec 13 23:03:23.385606 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 43/79] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:23 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:23.757648 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:23.758249 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:23.764146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:23.764568 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:23.765560 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:23.765964 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:23.920043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:23.928279 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-947fb7b2-dcae-4977-8086-14c36837dbca tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.174272 Dec 13 23:03:23.928855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 37/80] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:23 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:23.985668 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:23.987925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:24.000470 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.000919 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:24.004558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.005002 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:24.167640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:24.168512 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:24.169800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:24.175882 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6eb94b70-df71-4f85-a73a-40032e1d41ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1289 microversion: 2.1 time: 0.196115 Dec 13 23:03:24.176454 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 44/81] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:23 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1289 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:24.179275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.182712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:24.185091 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.185871 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:24.404013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:24.404817 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:24.420362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.421411 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:24.422539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.423295 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:24.937735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:24.950982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-91c0ece7-3875-4ba8-b2f8-45aaa6d4fb40 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.786928 Dec 13 23:03:24.953620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 38/82] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:24 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:24.966836 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:24.968329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:24.978705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.979460 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:24.980504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:24.981139 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:25.259362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:25.268306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:25.270238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:25.271576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a5ac225f-3d24-4757-b88a-0ffdf184c116 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.872653 Dec 13 23:03:25.272856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 45/83] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:24 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:25.277638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:25.278319 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:25.285029 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:25.286254 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:25.287099 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:25.287720 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:25.578147 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:25.586884 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-712123e3-12d0-4919-b4f5-8628f8d59b48 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.631866 Dec 13 23:03:25.589157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 39/84] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:24 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:25.664498 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:25.672159 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5fafbd29-0423-415f-8bd1-a64b057fc9a6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.398055 Dec 13 23:03:25.672724 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 46/85] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:25 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:25.971878 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:25.972897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:25.985009 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:25.985891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:25.987416 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:25.988010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.168955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:26.176293 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c3d06d4e-876f-43ee-8e28-64cb23051564 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.210492 Dec 13 23:03:26.176881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 40/86] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:25 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:26.291845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:26.293011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:26.299396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:26.303880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.304910 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:26.307222 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.320669 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-34c3de6e-dade-4c0e-9190-5ac235c6ac67 req-040e919e-6023-43d2-ae5c-57540754fa8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8b680f-031a-4c92-b62f-cf4069ffec8f", "tag": "80a67b49-708c-4b7f-8b08-ac990fa86f9e"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:26.323157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:26.323157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:03:26.335783 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-34c3de6e-dade-4c0e-9190-5ac235c6ac67 req-040e919e-6023-43d2-ae5c-57540754fa8b service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:26.336569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-34c3de6e-dade-4c0e-9190-5ac235c6ac67 req-040e919e-6023-43d2-ae5c-57540754fa8b service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.349080 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-34c3de6e-dade-4c0e-9190-5ac235c6ac67 req-040e919e-6023-43d2-ae5c-57540754fa8b service nova] Creating event network-changed:80a67b49-708c-4b7f-8b08-ac990fa86f9e for instance ff8b680f-031a-4c92-b62f-cf4069ffec8f on hv-cinder-79628 Dec 13 23:03:26.363330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-34c3de6e-dade-4c0e-9190-5ac235c6ac67 req-040e919e-6023-43d2-ae5c-57540754fa8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046466 Dec 13 23:03:26.364104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 41/87] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:03:26.501476 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:26.511162 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:26.513833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:26.515211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8ef27e0a-1e5b-4e5c-bac1-dab5dd47c4a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.228763 Dec 13 23:03:26.515951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 47/88] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:26 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:26.610328 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:26.611574 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:26.620432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:26.620821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.621629 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:26.622097 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.690965 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:26.691550 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:26.698436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:26.698907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.699782 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:26.700235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:26.782646 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:26.790687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b2218560-76e6-4c77-8d58-060efd54bcfc tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.186950 Dec 13 23:03:26.791295 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 42/89] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:26 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:26.856060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:26.864955 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e13d4473-3ab8-494b-8cd3-44ade6f08602 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.177965 Dec 13 23:03:26.865545 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 48/90] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:26 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:27.193855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:27.194518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:27.200972 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.201475 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.202259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.202790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.335622 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:27.343240 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f7159911-f6d1-4d13-bdd0-70b7055134f0 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.153261 Dec 13 23:03:27.343808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 43/91] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:27 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:27.535194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:27.535790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:27.542625 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.543087 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.543859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.544307 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.682901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:27.691225 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:27.692851 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:27.693997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1c60363c-06e5-4e67-be93-080df77082d4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.162993 Dec 13 23:03:27.694578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 49/92] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:27 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:27.807704 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:27.808297 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:27.814224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.814633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.815432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.815856 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.886939 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:27.887494 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:27.893575 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.894342 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.894797 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:27.895243 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:27.984836 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:27.992802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2ce7a469-a13d-4505-9b76-09d7840c7f6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.188841 Dec 13 23:03:27.993857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 44/93] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:27 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:28.055169 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:28.062911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-beecd844-3281-41b6-9e16-bed81e88b1a4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.182893 Dec 13 23:03:28.063472 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 50/94] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:27 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:28.360790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:28.361802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:28.385356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:28.386151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:28.387696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:28.405638 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:28.712259 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:28.712916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:28.720310 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:28.720494 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:28.723028 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:28.723650 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:29.067281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:29.079669 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6c1ab532-7b8b-41ff-a531-8e7de7d94a5b tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.723192 Dec 13 23:03:29.080255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 45/95] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:28 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:29.094005 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:29.096013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:29.114545 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:29.115199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:29.117579 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:29.118949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:29.153802 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:29.164129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:29.166428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:29.178375 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-04be4159-9f73-43d3-9ef8-a083236aa524 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.469643 Dec 13 23:03:29.179179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 51/96] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:28 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:29.184201 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:29.184807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:29.198006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:29.201093 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:29.202105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:29.202971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:29.403716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:29.423905 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-87582e90-5999-4c47-b780-3812a80af58c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.333164 Dec 13 23:03:29.424708 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 46/97] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:29 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:29.430966 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:29.443750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1c8f5740-1ccf-4dca-bdcb-da99e9a434db tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.263354 Dec 13 23:03:29.460014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 52/98] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:29 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:30.096906 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:30.097417 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:30.103817 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.105311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.106834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.107386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.197649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:30.198347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:30.205589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.206498 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.207939 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.208677 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.247009 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:30.257582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c69daf69-5ada-4e54-bd89-11e7313300b2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.164474 Dec 13 23:03:30.258170 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 47/99] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:30 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:30.348137 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:30.356364 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:30.358665 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:30.359877 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7c047edb-40ca-441a-9578-1031994a06b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.166337 Dec 13 23:03:30.360453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 53/100] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:30 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:30.442820 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:30.443505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:30.449883 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.450357 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.451156 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.451582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.461752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:30.462034 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:30.468305 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.468746 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.469571 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:30.469984 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:30.661964 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:30.669974 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f850ea21-fecd-415a-a7ec-9a8e5661256b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.230778 Dec 13 23:03:30.670551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 48/101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:30 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:30.679772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:30.680080 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-37e30c8d-d93d-4b34-9a5e-f21a9d2d8e41 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.222348 Dec 13 23:03:30.680659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 54/102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:30 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:31.274730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:31.275365 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:31.281602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.282041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.282839 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.283266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.379015 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:31.380147 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:31.389067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.389788 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.390929 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.391591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.424372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:31.432177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-51597445-2ecb-4fc6-b0ca-f7753f60a5e3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.161191 Dec 13 23:03:31.432758 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 49/103] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:31 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:31.535366 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:31.546347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:31.547891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:31.548987 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-afba1210-54be-4cc0-a452-fa7df83856a5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.173701 Dec 13 23:03:31.549561 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 55/104] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:31 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:03:31.687050 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:31.687744 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:31.699023 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:31.699624 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:31.705548 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.705994 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.706844 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.707303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.708072 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.708586 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.709507 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:31.710166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:31.907959 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:31.916213 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f4cdec47-14da-4130-96cc-a4696f0f2b38 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.221743 Dec 13 23:03:31.921412 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:31.930528 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 56/105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:31 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:31.931318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-08ff44e9-d2d1-4361-beea-45b585209d41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.247136 Dec 13 23:03:31.932028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 50/106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:31 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:32.450107 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:32.450703 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:32.456840 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.457271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:32.458070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.458499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:32.567823 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:32.568392 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:32.575871 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.576671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:32.577127 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.577614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:32.913698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:32.918189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:32.925003 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9445611c-c127-48f5-a581-7df4cf352fc3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.478934 Dec 13 23:03:32.925617 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 57/107] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:32 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:32.933745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:32.935109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:32.936212 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7db7a9f8-d8e7-4ad7-8392-f47039674eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.372449 Dec 13 23:03:32.937197 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 51/108] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:32 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:03:32.949727 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:32.950349 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:32.951150 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:32.951891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:32.957524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.958391 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:32.959609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.964020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.964468 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:32.965272 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:32.966071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:32.970610 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:33.168116 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:33.176198 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-047ddb37-baf9-45b9-a244-9cec9cb83212 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.229398 Dec 13 23:03:33.182713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:33.187177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 52/109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:32 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:33.190805 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b3c8ef6b-9a84-44f8-844f-0cbbe60a479f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.245269 Dec 13 23:03:33.191622 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 58/110] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:32 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:33.944348 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:33.944981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:33.951794 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:33.952235 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:33.953047 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:33.953504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:33.962384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:33.963053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:33.973566 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:33.974063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:33.974989 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:33.975301 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:34.247618 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:34.260846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:34.260846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:34.265904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-56e632e6-08ee-42e0-9f67-3ace65a1ab82 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.307879 Dec 13 23:03:34.266497 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 59/111] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:33 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:34.269808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:34.277596 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d2bd3b35-c09f-4611-b71c-2b63f41a4ce2 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.337375 Dec 13 23:03:34.279485 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 53/112] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:33 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:34.286145 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:34.286917 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:34.294893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:34.295494 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:34.305270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:34.305838 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:34.309852 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:34.310515 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:34.322105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:34.322795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:34.323625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:34.324190 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:34.544779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:34.553266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4832f967-040a-4ef1-af27-7357c10931de tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.271297 Dec 13 23:03:34.554092 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 54/113] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:34 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:34.560829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:34.569170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cf11fefd-0af6-4ec5-b979-582471062f35 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.288432 Dec 13 23:03:34.570184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 60/114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:34 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:35.285097 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:35.285896 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:35.298482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:35.299931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:35.307981 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.309444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.310136 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.310645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.310832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.311445 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.311665 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.312097 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.569149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:35.581540 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c962a2e9-e787-4527-80fc-d10c7dd90162 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.286890 Dec 13 23:03:35.584629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 61/115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:35 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:35.589759 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:35.590363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:35.599704 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.600416 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:35.606054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.606054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.606054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.620591 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:35.623477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:35.624834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-096b4669-fcff-4501-9cd3-9e4127cdae74 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.344412 Dec 13 23:03:35.636205 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 55/116] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:35 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:03:35.641461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:35.642319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:35.649090 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.649875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.650835 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:35.651493 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:35.805246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:35.816789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f1f81c76-4674-4ada-b480-32cabbd9afb1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.230959 Dec 13 23:03:35.817748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 62/117] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:35 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:35.845558 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:35.853993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7b939ea7-bde6-4d99-868a-0029d41c12ed tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.216471 Dec 13 23:03:35.854584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 56/118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:35 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:36.599977 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:36.600717 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:36.608712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.609170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:36.610003 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.610396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:36.643944 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:36.645977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:36.661529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.661974 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:36.662772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.663214 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:36.803145 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:36.812904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f92c2e8f-5b7b-480c-8e57-7179a1c9d5f8 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.216623 Dec 13 23:03:36.822999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 63/119] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:36 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:36.834753 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:36.836279 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:36.844202 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.847963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:36.849051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.852092 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:36.890684 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:36.910039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:36.912494 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:36.917356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-17aa1b80-7f37-4181-a183-e35cc7498a98 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.277586 Dec 13 23:03:36.928651 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 57/120] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:36 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:36.933903 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:36.935031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:36.973404 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.975593 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:36.978552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:36.979647 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:37.131323 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:37.139499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ed9ba9ce-7106-4850-8141-ff280e49289a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.308325 Dec 13 23:03:37.143111 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 64/121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:36 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:37.263404 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:37.270620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-557e1743-6376-46a4-8450-a943a3440a2b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.351239 Dec 13 23:03:37.271192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 58/122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:36 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:37.829720 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:37.830413 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:37.837785 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:37.838317 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:37.842750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:37.843363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:37.937174 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:37.939518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:37.946856 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:37.947636 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:37.949450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:37.950098 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:37.993429 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:38.001752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ad3b114d-b6c3-404b-8417-a4b0d2eafb24 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.175667 Dec 13 23:03:38.002344 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 65/123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:37 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:38.136350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:38.145551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:38.147683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:38.148793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8334ec37-fbfc-425c-8031-129cb9b4f57b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.216628 Dec 13 23:03:38.149377 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 59/124] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:37 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:03:38.181275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:38.184176 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:38.191189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:38.191658 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:38.193528 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:38.195208 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:38.233649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-5e82b0ed-2696-492d-ae3a-a99eefedd475 req-01dd6b8d-5919-4374-9f2c-9650c690dfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d21621-3cd9-4755-8588-0e8cb988d280", "name": "network-vif-plugged", "status": "completed", "tag": "9f7d1643-23b1-4ec2-997f-a41eed0290e7"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:38.235549 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:38.235549 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:03:38.243827 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-5e82b0ed-2696-492d-ae3a-a99eefedd475 req-01dd6b8d-5919-4374-9f2c-9650c690dfe6 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:38.244583 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-5e82b0ed-2696-492d-ae3a-a99eefedd475 req-01dd6b8d-5919-4374-9f2c-9650c690dfe6 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:38.267030 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-5e82b0ed-2696-492d-ae3a-a99eefedd475 req-01dd6b8d-5919-4374-9f2c-9650c690dfe6 service nova] Creating event network-vif-plugged:9f7d1643-23b1-4ec2-997f-a41eed0290e7 for instance 50d21621-3cd9-4755-8588-0e8cb988d280 on hv-cinder-79628 Dec 13 23:03:38.276749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-5e82b0ed-2696-492d-ae3a-a99eefedd475 req-01dd6b8d-5919-4374-9f2c-9650c690dfe6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175441 Dec 13 23:03:38.278228 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 66/125] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:03:38.289013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:38.289844 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:38.312032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:38.312525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:38.313463 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:38.313906 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:38.426108 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:38.434454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f9ec5df1-b133-4206-8554-3121005d8c7e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.259269 Dec 13 23:03:38.435021 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 60/126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:38 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:38.492208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:38.499753 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f6c56d41-2519-4ecd-99bd-1a065d6d477d tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.215902 Dec 13 23:03:38.500328 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 67/127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:38 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:39.023100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:39.024372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:39.032566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.034552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.036177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.037210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.170090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:39.170090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:39.175624 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.176069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.177031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.181861 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.233096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:39.244397 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-011c8039-7f9b-4793-bb1b-6962f4aa9881 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.228042 Dec 13 23:03:39.256110 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 61/128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:39 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:03:39.354216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:39.365506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:39.365506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:39.366837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2b510a03-4153-4e55-b273-1da352cf2019 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.203406 Dec 13 23:03:39.367482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 68/129] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:39 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:03:39.451473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:39.452075 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:39.459597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.459597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.459597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.459597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.522210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:39.522730 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:39.528977 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.529459 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.530246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:39.530681 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:39.633436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:39.640849 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-69ffbc02-6bff-45e2-ad26-12cb3aec1e8c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.193079 Dec 13 23:03:39.650408 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 62/130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:39 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:39.701065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:39.709548 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1dafc45b-80ed-46a9-9246-6c344f9ba1b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.191243 Dec 13 23:03:39.719376 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 69/131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:39 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:40.264125 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:40.264641 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:40.272338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.272338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.272651 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.272999 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.292724 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-72159ea7-f941-4c34-a516-2c98fe2977b3 req-dd4e03df-2045-47dc-911d-9d3912a54175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3b7009-1860-4939-a28b-e3d21862277b", "name": "network-vif-plugged", "status": "completed", "tag": "d64c863f-3d75-442c-ae28-629a3af23ac4"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:40.294431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:40.294431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:03:40.301882 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-72159ea7-f941-4c34-a516-2c98fe2977b3 req-dd4e03df-2045-47dc-911d-9d3912a54175 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.302772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-72159ea7-f941-4c34-a516-2c98fe2977b3 req-dd4e03df-2045-47dc-911d-9d3912a54175 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.316931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-72159ea7-f941-4c34-a516-2c98fe2977b3 req-dd4e03df-2045-47dc-911d-9d3912a54175 service nova] Creating event network-vif-plugged:d64c863f-3d75-442c-ae28-629a3af23ac4 for instance 1e3b7009-1860-4939-a28b-e3d21862277b on hv-cinder-79628 Dec 13 23:03:40.321952 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-72159ea7-f941-4c34-a516-2c98fe2977b3 req-dd4e03df-2045-47dc-911d-9d3912a54175 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032905 Dec 13 23:03:40.322534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 70/132] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:40.387458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:40.388265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:40.395534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.396225 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.397573 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.398279 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.486465 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:40.494853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e69a08d8-38cb-4862-9dce-1807b2474173 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.234823 Dec 13 23:03:40.499900 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 63/133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:40 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:40.659974 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:40.660663 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:40.678529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.680195 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.681039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.683811 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.704493 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:40.715224 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:40.718277 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:40.719624 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ebd9e8ea-b158-418a-8d9f-2f55cdb09794 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.337013 Dec 13 23:03:40.721739 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 71/134] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:40 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:40.727053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:40.727666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:40.738915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.739122 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.739910 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:40.740567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:40.983456 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:40.991612 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8b3aaeeb-622a-4f6d-85db-9b0d065727c3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.336466 Dec 13 23:03:40.992183 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 64/135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:40 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:40.993866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:41.002179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-83298140-5894-410c-98f6-a03a6a4434b6 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1318 microversion: 2.1 time: 0.279114 Dec 13 23:03:41.002751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 72/136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:40 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:41.512481 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:41.513041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:41.519306 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:41.519761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:41.520527 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:41.520955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:41.658363 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:41.665924 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5e83472c-f0a1-4fd2-b5c9-832cf285abba tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.157150 Dec 13 23:03:41.666493 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 65/137] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:41 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:41.740320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:41.740909 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:41.747181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:41.747595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:41.748388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:41.748832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:41.883597 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:41.898195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:41.899736 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:41.900879 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bbe056fe-02e8-44ed-9064-624aa471de30 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.164240 Dec 13 23:03:41.901461 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 73/138] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:41 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:42.008146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:42.009472 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:42.017993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.018447 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.019421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.019859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.019987 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:42.021134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:42.029032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.029713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.030662 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.031092 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.229899 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:42.233595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:42.241897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d46f5706-ec0e-4cd3-b64f-c48c840e9b7f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.237443 Dec 13 23:03:42.242463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 66/139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:42 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:42.243867 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f3a2e858-21e4-4856-929c-8e6f61eb9c77 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1509 microversion: 2.1 time: 0.228127 Dec 13 23:03:42.244455 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 74/140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:42 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:42.342653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-fcdd76e4-ad60-4284-9664-6e8f1c166bba req-5efe28e5-2ec5-405c-abc6-dfc2ebe0b915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168526af-2c4e-4e84-8b87-7f2e71d96e16", "name": "network-vif-plugged", "status": "completed", "tag": "ef742767-361d-4046-8bd3-5b8f1c34e632"}, {"server_uuid": "ff8b680f-031a-4c92-b62f-cf4069ffec8f", "name": "network-vif-plugged", "status": "completed", "tag": "80a67b49-708c-4b7f-8b08-ac990fa86f9e"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:42.344879 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:42.344879 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:03:42.359215 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fcdd76e4-ad60-4284-9664-6e8f1c166bba req-5efe28e5-2ec5-405c-abc6-dfc2ebe0b915 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.359215 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fcdd76e4-ad60-4284-9664-6e8f1c166bba req-5efe28e5-2ec5-405c-abc6-dfc2ebe0b915 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.378501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-fcdd76e4-ad60-4284-9664-6e8f1c166bba req-5efe28e5-2ec5-405c-abc6-dfc2ebe0b915 service nova] Creating event network-vif-plugged:ef742767-361d-4046-8bd3-5b8f1c34e632 for instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 on hv-cinder-79628 Dec 13 23:03:42.379014 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-fcdd76e4-ad60-4284-9664-6e8f1c166bba req-5efe28e5-2ec5-405c-abc6-dfc2ebe0b915 service nova] Creating event network-vif-plugged:80a67b49-708c-4b7f-8b08-ac990fa86f9e for instance ff8b680f-031a-4c92-b62f-cf4069ffec8f on hv-cinder-79628 Dec 13 23:03:42.385896 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-fcdd76e4-ad60-4284-9664-6e8f1c166bba req-5efe28e5-2ec5-405c-abc6-dfc2ebe0b915 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048155 Dec 13 23:03:42.386909 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 67/141] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:42 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:42.684531 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:42.685164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:42.692479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.692890 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.693886 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.694322 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.883521 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:42.892350 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6217568b-c41e-4904-a973-6dced890996c tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.212802 Dec 13 23:03:42.899756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 75/142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:42 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:42.920343 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:42.921043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:42.927712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.928162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:42.929012 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:42.929504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:43.067764 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:43.074032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:43.075492 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:43.076610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-20ac3d27-c010-4040-87af-7ec80eb7eb5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.160892 Dec 13 23:03:43.077378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 68/143] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:42 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:43.260357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:43.261099 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:43.267125 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:43.267567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:43.268335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:43.268757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:43.403605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:43.411496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d888ee47-6c90-4375-8b4c-e6a21fe57d7c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.155063 Dec 13 23:03:43.412239 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 76/144] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:43 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:43.910392 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:43.910994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:43.917868 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:43.918308 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:43.919081 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:43.919500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:44.051841 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:44.060630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7e5c6803-170f-4fdf-ac81-41beef0f9194 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.153760 Dec 13 23:03:44.061151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 69/145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:43 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:44.095535 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:44.096315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:44.103416 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:44.104010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:44.105266 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:44.105795 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:44.273240 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:44.281378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:44.282915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:44.283999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-58da4546-e2e4-4923-b453-e499cc74975d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.192740 Dec 13 23:03:44.284559 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 77/146] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:44 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:44.429650 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:44.430283 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:44.436633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:44.437076 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:44.437878 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:44.438307 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:44.576464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:44.584188 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-09a2a8a3-ffa2-4bd5-85b0-eab754f67adc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.158672 Dec 13 23:03:44.584754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 70/147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:44 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:44.716540 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-eb30823e-065a-47ab-9546-4281af563d26 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df26725c-483f-46fb-bc86-288b5968244d"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:44.717686 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-eb30823e-065a-47ab-9546-4281af563d26 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:44.724169 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb30823e-065a-47ab-9546-4281af563d26 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:44.724609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb30823e-065a-47ab-9546-4281af563d26 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:44.725395 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb30823e-065a-47ab-9546-4281af563d26 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:44.725847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb30823e-065a-47ab-9546-4281af563d26 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:45.077877 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:45.078450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:45.084910 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:45.085377 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:45.086151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:45.086578 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:45.220555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:45.228458 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-742ed25d-6efa-418f-a61f-aeea7d853916 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.154229 Dec 13 23:03:45.229444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 71/148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:45 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:45.303155 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:45.303757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:45.310356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:45.310798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:45.311570 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:45.311993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:45.449037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:45.459696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:45.462096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:45.463270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-30fda57e-3323-496e-b513-4eeef9e876c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.164244 Dec 13 23:03:45.463850 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 72/149] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:45 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:45.602292 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:45.602895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:45.609507 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:45.609946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:45.610715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:45.611138 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:45.751120 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:45.762900 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-898236ac-b536-424e-a8ca-c8af44402c4a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.164261 Dec 13 23:03:45.763488 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 73/150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:45 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:46.251457 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:46.252485 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:46.262617 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:46.263255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:46.264062 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:46.264498 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:46.404962 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:46.412330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-648b4007-d543-407d-b1bb-f0271fca13e5 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.168089 Dec 13 23:03:46.412895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 74/151] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:46 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:46.482220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:46.482906 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:46.491253 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:46.491705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:46.492502 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:46.492929 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:46.631705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:46.640053 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:46.641550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:46.642668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d827f43a-a730-4a92-b53d-33f44e21544e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.164593 Dec 13 23:03:46.643192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 75/152] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:46 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:46.780149 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:46.780753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:46.787217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:46.787699 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:46.788477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:46.788910 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:46.931100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:46.938948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-59c1ec8f-df4b-426e-bca6-219da793e093 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.162546 Dec 13 23:03:46.939492 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 76/153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:46 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:47.434441 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:47.435557 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:47.445856 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:47.446575 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:47.447755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:47.448536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:47.592122 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:47.599682 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a33bd685-7ef7-4ca6-8e3e-d285fb7f5b5d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1315 microversion: 2.1 time: 0.171408 Dec 13 23:03:47.600256 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 77/154] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:47 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:47.660716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:47.661318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:47.668223 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:47.668934 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:47.670455 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:47.671071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:47.821712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:47.830790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:47.832275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:47.833580 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f1fcfac6-d7da-4424-b469-8cea57a6b919 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.176866 Dec 13 23:03:47.834421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 78/155] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:47 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:47.921296 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-eb30823e-065a-47ab-9546-4281af563d26 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.208455 Dec 13 23:03:47.921944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 78/156] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:03:44 2021] POST /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments => generated 194 bytes in 3210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:47.955930 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:47.956445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:47.962823 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:47.963274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:47.964074 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:47.964501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:48.103592 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:48.114687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1289ec89-87b2-4a76-9a68-d4ef15f2819f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1362 microversion: 2.1 time: 0.161368 Dec 13 23:03:48.125173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 79/157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:47 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:48.618367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:48.618993 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:48.625727 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:48.626201 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:48.627031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:48.627482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:48.771849 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:48.779829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c07252c8-38aa-4ee0-abc7-fb59f5859df1 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1501 microversion: 2.1 time: 0.166403 Dec 13 23:03:48.781628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 79/158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:48 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:48.852350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:48.852947 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:48.859357 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:48.859809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:48.860594 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:48.861024 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:49.024224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:49.035446 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:49.038470 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:49.040036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c255dd88-160f-47e0-b9b4-1cb2ee9eab1e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1405 microversion: 2.20 time: 0.191811 Dec 13 23:03:49.041085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 80/159] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:48 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:49.137787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:49.139819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:49.169074 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:49.170412 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:49.171667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:49.172279 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:49.334467 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:49.342897 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-14f77e0a-a576-47a3-943f-0e36e181c805 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1547 microversion: 2.1 time: 0.214224 Dec 13 23:03:49.343645 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 80/160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:03:49 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1547 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:49.360280 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-33d4b9a8-ce02-4ce1-9b8a-127a0ea753f9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:49.360769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-33d4b9a8-ce02-4ce1-9b8a-127a0ea753f9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:49.367210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33d4b9a8-ce02-4ce1-9b8a-127a0ea753f9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:49.367655 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33d4b9a8-ce02-4ce1-9b8a-127a0ea753f9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:49.368428 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33d4b9a8-ce02-4ce1-9b8a-127a0ea753f9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:49.368857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-33d4b9a8-ce02-4ce1-9b8a-127a0ea753f9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:49.487585 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-33d4b9a8-ce02-4ce1-9b8a-127a0ea753f9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131185 Dec 13 23:03:49.488218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 81/161] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Dec 13 23:03:49 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:03:50.059727 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:50.060510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:50.067772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:50.068301 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:50.069151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:50.069674 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:50.235418 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:50.249582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:50.251283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:03:50.252915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-74d9947b-df1b-4ce4-9f58-eb81b6280369 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1596 microversion: 2.20 time: 0.197185 Dec 13 23:03:50.253543 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 81/162] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:03:50 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1596 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:03:50.274581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-965b216f-0c7f-4552-b137-6f515bb6b82a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:03:50.275186 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-965b216f-0c7f-4552-b137-6f515bb6b82a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:50.297115 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6a44ba38-3942-4098-a103-37d0802e2305 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7532ae9-eb1f-467b-9e60-03dfd3c7ae79"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:50.303039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-965b216f-0c7f-4552-b137-6f515bb6b82a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:50.303503 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-965b216f-0c7f-4552-b137-6f515bb6b82a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:50.304313 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-965b216f-0c7f-4552-b137-6f515bb6b82a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:50.304623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6a44ba38-3942-4098-a103-37d0802e2305 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:50.309825 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-965b216f-0c7f-4552-b137-6f515bb6b82a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:50.317133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6a44ba38-3942-4098-a103-37d0802e2305 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:50.317925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6a44ba38-3942-4098-a103-37d0802e2305 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:50.318938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6a44ba38-3942-4098-a103-37d0802e2305 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:50.321753 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6a44ba38-3942-4098-a103-37d0802e2305 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:50.479148 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-965b216f-0c7f-4552-b137-6f515bb6b82a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.209801 Dec 13 23:03:50.487532 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 82/163] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Dec 13 23:03:50 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:03:50.730689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6a44ba38-3942-4098-a103-37d0802e2305 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "POST /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437721 Dec 13 23:03:50.732101 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 82/164] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:03:50 2021] POST /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:03:51.251382 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-11133d58-fa7d-4bd8-8ab4-7b40910958a2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:51.252481 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-11133d58-fa7d-4bd8-8ab4-7b40910958a2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:51.268818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11133d58-fa7d-4bd8-8ab4-7b40910958a2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:51.270347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11133d58-fa7d-4bd8-8ab4-7b40910958a2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:51.270612 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-34923b3d-585b-4237-85bd-19e82b6b6d88 req-6906feb8-2f27-4b32-9853-0d3179b3f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8b680f-031a-4c92-b62f-cf4069ffec8f", "tag": "80a67b49-708c-4b7f-8b08-ac990fa86f9e"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:51.272021 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11133d58-fa7d-4bd8-8ab4-7b40910958a2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:51.272200 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:51.272200 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:03:51.273838 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11133d58-fa7d-4bd8-8ab4-7b40910958a2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:51.279477 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-34923b3d-585b-4237-85bd-19e82b6b6d88 req-6906feb8-2f27-4b32-9853-0d3179b3f1ed service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:51.285051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-34923b3d-585b-4237-85bd-19e82b6b6d88 req-6906feb8-2f27-4b32-9853-0d3179b3f1ed service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:51.332591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-34923b3d-585b-4237-85bd-19e82b6b6d88 req-6906feb8-2f27-4b32-9853-0d3179b3f1ed service nova] Creating event network-changed:80a67b49-708c-4b7f-8b08-ac990fa86f9e for instance ff8b680f-031a-4c92-b62f-cf4069ffec8f on hv-cinder-79628 Dec 13 23:03:51.352457 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-34923b3d-585b-4237-85bd-19e82b6b6d88 req-6906feb8-2f27-4b32-9853-0d3179b3f1ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087142 Dec 13 23:03:51.362753 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 83/165] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:03:51.426573 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-11133d58-fa7d-4bd8-8ab4-7b40910958a2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.179053 Dec 13 23:03:51.427764 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 83/166] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:03:51 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:03:52.394099 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7824865a-2fd4-4bcf-b059-08e0494b4923 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:52.396031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7824865a-2fd4-4bcf-b059-08e0494b4923 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:52.405995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-a4cf5b61-0bb1-4a36-a0b2-af086bc2a703 req-099a5925-bb93-4d30-ad1e-9b34bdc434f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168526af-2c4e-4e84-8b87-7f2e71d96e16", "tag": "ef742767-361d-4046-8bd3-5b8f1c34e632"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:52.407510 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:03:52.407510 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:03:52.410595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7824865a-2fd4-4bcf-b059-08e0494b4923 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:52.411321 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7824865a-2fd4-4bcf-b059-08e0494b4923 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:52.412331 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7824865a-2fd4-4bcf-b059-08e0494b4923 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:52.412971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7824865a-2fd4-4bcf-b059-08e0494b4923 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:52.423451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-a4cf5b61-0bb1-4a36-a0b2-af086bc2a703 req-099a5925-bb93-4d30-ad1e-9b34bdc434f5 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:52.423451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-a4cf5b61-0bb1-4a36-a0b2-af086bc2a703 req-099a5925-bb93-4d30-ad1e-9b34bdc434f5 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:52.434714 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-a4cf5b61-0bb1-4a36-a0b2-af086bc2a703 req-099a5925-bb93-4d30-ad1e-9b34bdc434f5 service nova] Creating event network-changed:ef742767-361d-4046-8bd3-5b8f1c34e632 for instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 on hv-cinder-79628 Dec 13 23:03:52.441223 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-a4cf5b61-0bb1-4a36-a0b2-af086bc2a703 req-099a5925-bb93-4d30-ad1e-9b34bdc434f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040876 Dec 13 23:03:52.451301 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 84/167] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:03:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:03:52.508345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-55cdd41a-4f42-4dd1-957c-0367a49efd23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:52.514099 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-55cdd41a-4f42-4dd1-957c-0367a49efd23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:52.516066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7824865a-2fd4-4bcf-b059-08e0494b4923 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.126249 Dec 13 23:03:52.516821 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 84/168] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:03:52 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:52.536179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55cdd41a-4f42-4dd1-957c-0367a49efd23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:52.542115 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55cdd41a-4f42-4dd1-957c-0367a49efd23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:52.543104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55cdd41a-4f42-4dd1-957c-0367a49efd23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:52.543642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55cdd41a-4f42-4dd1-957c-0367a49efd23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:52.649698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-55cdd41a-4f42-4dd1-957c-0367a49efd23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.172776 Dec 13 23:03:52.650449 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 85/169] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:03:52 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:03:53.537506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ae9bde45-2573-419c-99a2-bd4a445ba3a7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:53.539861 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ae9bde45-2573-419c-99a2-bd4a445ba3a7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:53.558850 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9bde45-2573-419c-99a2-bd4a445ba3a7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:53.561094 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9bde45-2573-419c-99a2-bd4a445ba3a7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:53.564662 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9bde45-2573-419c-99a2-bd4a445ba3a7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:53.566174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9bde45-2573-419c-99a2-bd4a445ba3a7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:53.663579 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c95c60c7-ad21-489a-be2b-e0cea2dec557 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:53.664610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c95c60c7-ad21-489a-be2b-e0cea2dec557 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:53.665192 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ae9bde45-2573-419c-99a2-bd4a445ba3a7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.141085 Dec 13 23:03:53.665929 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 85/170] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:03:53 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:53.675782 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c95c60c7-ad21-489a-be2b-e0cea2dec557 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:53.679253 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c95c60c7-ad21-489a-be2b-e0cea2dec557 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:53.680067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c95c60c7-ad21-489a-be2b-e0cea2dec557 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:53.680499 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c95c60c7-ad21-489a-be2b-e0cea2dec557 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:53.787619 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c95c60c7-ad21-489a-be2b-e0cea2dec557 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.129210 Dec 13 23:03:53.788357 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 86/171] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:03:53 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:03:54.678170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-375ef04a-45d5-4668-b779-9142fe9fa8a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:54.679209 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-375ef04a-45d5-4668-b779-9142fe9fa8a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:54.687002 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-375ef04a-45d5-4668-b779-9142fe9fa8a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:54.687002 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-375ef04a-45d5-4668-b779-9142fe9fa8a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:54.687814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-375ef04a-45d5-4668-b779-9142fe9fa8a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:54.688246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-375ef04a-45d5-4668-b779-9142fe9fa8a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:54.761224 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-375ef04a-45d5-4668-b779-9142fe9fa8a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.087392 Dec 13 23:03:54.762520 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 86/172] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:03:54 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:54.799013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fea68fae-1131-4650-9fa0-3fa759f37346 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:54.800035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fea68fae-1131-4650-9fa0-3fa759f37346 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:54.806537 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fea68fae-1131-4650-9fa0-3fa759f37346 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:54.806973 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fea68fae-1131-4650-9fa0-3fa759f37346 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:54.807737 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fea68fae-1131-4650-9fa0-3fa759f37346 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:54.808162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fea68fae-1131-4650-9fa0-3fa759f37346 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:55.774712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cc300a7d-5f72-4388-b10a-9ae85de1d37f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:55.775729 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cc300a7d-5f72-4388-b10a-9ae85de1d37f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:55.783149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc300a7d-5f72-4388-b10a-9ae85de1d37f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:55.783755 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc300a7d-5f72-4388-b10a-9ae85de1d37f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:55.791828 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc300a7d-5f72-4388-b10a-9ae85de1d37f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:55.792321 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc300a7d-5f72-4388-b10a-9ae85de1d37f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:57.695813 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fea68fae-1131-4650-9fa0-3fa759f37346 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 2.900727 Dec 13 23:03:57.696502 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 87/173] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:03:54 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 2903 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:03:57.714972 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cc300a7d-5f72-4388-b10a-9ae85de1d37f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 1.945076 Dec 13 23:03:57.718260 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 87/174] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:03:55 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:58.707683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3421f958-6c62-424a-8186-95877b46d4da tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:58.713128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3421f958-6c62-424a-8186-95877b46d4da tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:58.717162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3421f958-6c62-424a-8186-95877b46d4da tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:58.717642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3421f958-6c62-424a-8186-95877b46d4da tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:58.718523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3421f958-6c62-424a-8186-95877b46d4da tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:58.721246 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3421f958-6c62-424a-8186-95877b46d4da tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:58.730486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-16b0b7f7-93f2-469b-9a33-bf4f55deea09 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:58.732591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-16b0b7f7-93f2-469b-9a33-bf4f55deea09 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:58.742079 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-16b0b7f7-93f2-469b-9a33-bf4f55deea09 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:58.742775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-16b0b7f7-93f2-469b-9a33-bf4f55deea09 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:58.743673 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-16b0b7f7-93f2-469b-9a33-bf4f55deea09 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:58.744273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-16b0b7f7-93f2-469b-9a33-bf4f55deea09 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:58.816094 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-16b0b7f7-93f2-469b-9a33-bf4f55deea09 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.092720 Dec 13 23:03:58.816771 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 88/175] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:03:58 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:58.832654 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3421f958-6c62-424a-8186-95877b46d4da tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.129800 Dec 13 23:03:58.833473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 88/176] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:03:58 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:03:59.827448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9221b706-4caf-47c4-b7bd-7f8ad9200c4c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:59.828440 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9221b706-4caf-47c4-b7bd-7f8ad9200c4c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:59.836184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9221b706-4caf-47c4-b7bd-7f8ad9200c4c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:59.836660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9221b706-4caf-47c4-b7bd-7f8ad9200c4c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:59.837735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9221b706-4caf-47c4-b7bd-7f8ad9200c4c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:59.838391 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9221b706-4caf-47c4-b7bd-7f8ad9200c4c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:59.844948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f37e2fd5-6f93-4f5c-bccf-acd21bd3d277 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:03:59.846923 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f37e2fd5-6f93-4f5c-bccf-acd21bd3d277 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:03:59.854216 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f37e2fd5-6f93-4f5c-bccf-acd21bd3d277 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:59.854890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f37e2fd5-6f93-4f5c-bccf-acd21bd3d277 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:59.855845 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f37e2fd5-6f93-4f5c-bccf-acd21bd3d277 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:03:59.856280 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f37e2fd5-6f93-4f5c-bccf-acd21bd3d277 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:03:59.912194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9221b706-4caf-47c4-b7bd-7f8ad9200c4c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.088617 Dec 13 23:03:59.913364 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 89/177] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:03:59 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:03:59.930472 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f37e2fd5-6f93-4f5c-bccf-acd21bd3d277 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.090190 Dec 13 23:03:59.933719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 89/178] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:03:59 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:00.266180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1670088557", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "e25a0760-1b13-4e1d-bcac-3c85e52e485e"}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:00.329268 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] validate_networks() for [('e25a0760-1b13-4e1d-bcac-3c85e52e485e', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:04:00.711482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:04:00.711901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:04:00.712372 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:04:00.712773 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:04:00.713182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:04:00.722079 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:00.722525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:00.723342 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:00.723769 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:00.740556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:04:00.744407 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for user 916e287d50864a638d3b1efe692e78e4 and project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:04:00.755672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:04:00.758278 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:04:00.829478 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0a423595-e742-4bbc-9c18-c2fa09e10a84 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567442 Dec 13 23:04:00.834224 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 90/179] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:04:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:04:00.840373 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8c3abcf8-ccf1-4b4b-aca1-cefded89a121 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:00.841068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8c3abcf8-ccf1-4b4b-aca1-cefded89a121 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:00.923672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ccbafc38-601d-4ec0-89ab-5decfaf450de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:00.924663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ccbafc38-601d-4ec0-89ab-5decfaf450de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:00.932749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccbafc38-601d-4ec0-89ab-5decfaf450de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:00.933657 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccbafc38-601d-4ec0-89ab-5decfaf450de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:00.936528 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccbafc38-601d-4ec0-89ab-5decfaf450de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:00.937272 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccbafc38-601d-4ec0-89ab-5decfaf450de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:00.977755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8c3abcf8-ccf1-4b4b-aca1-cefded89a121 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:00.991074 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8c3abcf8-ccf1-4b4b-aca1-cefded89a121 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1218 microversion: 2.1 time: 0.154139 Dec 13 23:04:00.992082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 90/180] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:00 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:00.997396 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1cc69fe8-e008-4112-8b94-22c06f1fe040 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:00.998726 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1cc69fe8-e008-4112-8b94-22c06f1fe040 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:01.006237 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1cc69fe8-e008-4112-8b94-22c06f1fe040 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:01.007198 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1cc69fe8-e008-4112-8b94-22c06f1fe040 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:01.008176 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1cc69fe8-e008-4112-8b94-22c06f1fe040 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:01.008774 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1cc69fe8-e008-4112-8b94-22c06f1fe040 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:01.036933 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ccbafc38-601d-4ec0-89ab-5decfaf450de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.117281 Dec 13 23:04:01.037636 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 91/181] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:00 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:01.100690 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1cc69fe8-e008-4112-8b94-22c06f1fe040 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.106700 Dec 13 23:04:01.104551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 91/182] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:00 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:02.009195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:02.015823 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:02.022959 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:02.023404 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:02.024378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:02.024987 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:02.048321 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6cbd2fc1-0162-47d2-99c7-1c440bf69370 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:02.050101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6cbd2fc1-0162-47d2-99c7-1c440bf69370 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:02.058647 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cbd2fc1-0162-47d2-99c7-1c440bf69370 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:02.059342 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cbd2fc1-0162-47d2-99c7-1c440bf69370 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:02.060612 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cbd2fc1-0162-47d2-99c7-1c440bf69370 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:02.061243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cbd2fc1-0162-47d2-99c7-1c440bf69370 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:02.133871 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:02.144601 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0bcf2ed0-d3a9-4f19-8d78-03dfb686c1f3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1270 microversion: 2.1 time: 0.139552 Dec 13 23:04:02.145177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 92/183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:02 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:02.156068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-52944dff-72e0-4cd0-9343-5cc72e228826 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:02.157261 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-52944dff-72e0-4cd0-9343-5cc72e228826 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:02.164541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-52944dff-72e0-4cd0-9343-5cc72e228826 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:02.165544 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-52944dff-72e0-4cd0-9343-5cc72e228826 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:02.166646 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-52944dff-72e0-4cd0-9343-5cc72e228826 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:02.167129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-52944dff-72e0-4cd0-9343-5cc72e228826 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:02.194347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6cbd2fc1-0162-47d2-99c7-1c440bf69370 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.150201 Dec 13 23:04:02.195849 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 92/184] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:02 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:02.274018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-52944dff-72e0-4cd0-9343-5cc72e228826 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.122842 Dec 13 23:04:02.288671 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 93/185] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:02 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:03.163346 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:03.164121 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:03.180934 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:03.181588 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:03.183292 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:03.183842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:03.208694 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6f10647f-7e6a-4fd6-8bca-9bfb43ded346 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:03.210066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6f10647f-7e6a-4fd6-8bca-9bfb43ded346 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:03.218956 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6f10647f-7e6a-4fd6-8bca-9bfb43ded346 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:03.219712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6f10647f-7e6a-4fd6-8bca-9bfb43ded346 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:03.221090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6f10647f-7e6a-4fd6-8bca-9bfb43ded346 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:03.222027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6f10647f-7e6a-4fd6-8bca-9bfb43ded346 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:03.321591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6f10647f-7e6a-4fd6-8bca-9bfb43ded346 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.117568 Dec 13 23:04:03.325563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 94/186] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:03 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:03.331335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-32748657-357d-47a6-b69a-3324fda97471 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:03.332666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-32748657-357d-47a6-b69a-3324fda97471 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:03.340569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-32748657-357d-47a6-b69a-3324fda97471 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:03.342010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-32748657-357d-47a6-b69a-3324fda97471 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:03.343054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-32748657-357d-47a6-b69a-3324fda97471 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:03.343586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-32748657-357d-47a6-b69a-3324fda97471 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:03.447374 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-32748657-357d-47a6-b69a-3324fda97471 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.122283 Dec 13 23:04:03.448663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 95/187] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:03 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:03.497590 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:03.505584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2dc9a371-c4dd-4d3e-92fe-baf2d908a437 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1318 microversion: 2.1 time: 0.347669 Dec 13 23:04:03.506169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 93/188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:03 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:04.147346 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-66decf3c-640c-4cd0-bb78-ab34592da2a4 req-495daac4-e544-4438-90a9-1c7053963240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353b59fe-6794-411b-82f2-ac6f7dba75d4", "tag": "02ed001c-6e95-48af-96d5-9f200d0fb881"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:04.149163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:04.149163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:04.167947 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-66decf3c-640c-4cd0-bb78-ab34592da2a4 req-495daac4-e544-4438-90a9-1c7053963240 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:04.168654 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-66decf3c-640c-4cd0-bb78-ab34592da2a4 req-495daac4-e544-4438-90a9-1c7053963240 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:04.196629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-66decf3c-640c-4cd0-bb78-ab34592da2a4 req-495daac4-e544-4438-90a9-1c7053963240 service nova] Creating event network-changed:02ed001c-6e95-48af-96d5-9f200d0fb881 for instance 353b59fe-6794-411b-82f2-ac6f7dba75d4 on hv-cinder-79628 Dec 13 23:04:04.206845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-66decf3c-640c-4cd0-bb78-ab34592da2a4 req-495daac4-e544-4438-90a9-1c7053963240 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064921 Dec 13 23:04:04.208074 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 96/189] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:04.336859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7b6df717-2d3c-4c85-b9cf-2388ece2bd10 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:04.338758 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7b6df717-2d3c-4c85-b9cf-2388ece2bd10 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:04.349375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b6df717-2d3c-4c85-b9cf-2388ece2bd10 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:04.350117 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b6df717-2d3c-4c85-b9cf-2388ece2bd10 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:04.351265 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b6df717-2d3c-4c85-b9cf-2388ece2bd10 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:04.352175 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b6df717-2d3c-4c85-b9cf-2388ece2bd10 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:04.439643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7b6df717-2d3c-4c85-b9cf-2388ece2bd10 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.109852 Dec 13 23:04:04.440833 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 94/190] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:04 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:04.461434 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8db87948-4e86-497c-bb92-dfeb1ebfd1ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:04.463972 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8db87948-4e86-497c-bb92-dfeb1ebfd1ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:04.479038 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8db87948-4e86-497c-bb92-dfeb1ebfd1ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:04.479751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8db87948-4e86-497c-bb92-dfeb1ebfd1ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:04.481238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8db87948-4e86-497c-bb92-dfeb1ebfd1ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:04.482173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8db87948-4e86-497c-bb92-dfeb1ebfd1ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:04.524559 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:04.525758 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:04.533053 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:04.533979 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:04.534873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:04.535653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:04.565750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8db87948-4e86-497c-bb92-dfeb1ebfd1ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.109841 Dec 13 23:04:04.566780 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 97/191] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:04 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:04:04.789307 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:04.797101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-126e20d0-eefb-47a4-8ff8-bd74ce6d680f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1318 microversion: 2.1 time: 0.276822 Dec 13 23:04:04.797707 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 95/192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:04 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:05.453676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b307dd24-39fe-4d03-84de-7f2f8c4c69ae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:05.455098 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b307dd24-39fe-4d03-84de-7f2f8c4c69ae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:05.464224 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b307dd24-39fe-4d03-84de-7f2f8c4c69ae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:05.465378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b307dd24-39fe-4d03-84de-7f2f8c4c69ae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:05.466719 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b307dd24-39fe-4d03-84de-7f2f8c4c69ae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:05.467313 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b307dd24-39fe-4d03-84de-7f2f8c4c69ae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:05.579267 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-93d280e8-1691-410d-acbd-f03432231733 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:05.580193 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-93d280e8-1691-410d-acbd-f03432231733 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:05.588854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-93d280e8-1691-410d-acbd-f03432231733 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:05.589251 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-93d280e8-1691-410d-acbd-f03432231733 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:05.590426 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-93d280e8-1691-410d-acbd-f03432231733 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:05.591023 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-93d280e8-1691-410d-acbd-f03432231733 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:05.594760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b307dd24-39fe-4d03-84de-7f2f8c4c69ae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.146236 Dec 13 23:04:05.595525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 98/193] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:05 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:05.677474 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-93d280e8-1691-410d-acbd-f03432231733 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.101855 Dec 13 23:04:05.678532 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 96/194] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:05 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:05.815873 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:05.816806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:05.831475 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:05.832133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:05.832940 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:05.833396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:06.004523 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:06.013230 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9e68115a-e65f-4aaa-af04-9340fbd95644 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1318 microversion: 2.1 time: 0.200811 Dec 13 23:04:06.013855 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 99/195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:05 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:06.607009 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-23abdead-8143-4fac-9804-4131ed63e281 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:06.608204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-23abdead-8143-4fac-9804-4131ed63e281 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:06.615968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23abdead-8143-4fac-9804-4131ed63e281 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:06.616415 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23abdead-8143-4fac-9804-4131ed63e281 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:06.617204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23abdead-8143-4fac-9804-4131ed63e281 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:06.617671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-23abdead-8143-4fac-9804-4131ed63e281 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:06.684053 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-23abdead-8143-4fac-9804-4131ed63e281 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.081047 Dec 13 23:04:06.687531 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 97/196] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:06 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:06.691796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-51ba2f95-b905-4134-a666-f436c34730b6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:06.693181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-51ba2f95-b905-4134-a666-f436c34730b6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:06.700339 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51ba2f95-b905-4134-a666-f436c34730b6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:06.700899 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51ba2f95-b905-4134-a666-f436c34730b6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:06.701748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51ba2f95-b905-4134-a666-f436c34730b6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:06.702184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51ba2f95-b905-4134-a666-f436c34730b6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:06.779318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-51ba2f95-b905-4134-a666-f436c34730b6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.092799 Dec 13 23:04:06.780280 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 100/197] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:06 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:04:06.962964 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:06.963548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:06.971513 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:06.972009 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:06.973809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:06.974423 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.008106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:04:07.032507 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:07.045744 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:07.059411 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.059774 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.060616 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.061076 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.124301 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-679f13ed-1772-481a-9c15-7556070d9a49 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 204 len: 0 microversion: 2.1 time: 0.164879 Dec 13 23:04:07.128910 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 98/198] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:04:06 2021] DELETE /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:04:07.134361 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:07.135169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:07.141968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.142541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.143489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.144311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.260911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:07.273238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1fcbcd0b-8954-4cfd-a0d4-3a98a3ab4650 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1318 microversion: 2.1 time: 0.245768 Dec 13 23:04:07.273892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 101/199] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:07 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:07.324540 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:07.334348 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1347317b-c39f-43a4-a5c6-4266695f868a tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1553 microversion: 2.1 time: 0.203963 Dec 13 23:04:07.334936 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 99/200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:07 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:07.697483 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4cf0889a-13c9-481e-bcbb-c59b5fd77204 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:07.699805 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4cf0889a-13c9-481e-bcbb-c59b5fd77204 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:07.710125 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cf0889a-13c9-481e-bcbb-c59b5fd77204 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.711064 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cf0889a-13c9-481e-bcbb-c59b5fd77204 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.712687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cf0889a-13c9-481e-bcbb-c59b5fd77204 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.714027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cf0889a-13c9-481e-bcbb-c59b5fd77204 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.795677 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-19c86a21-d338-4cd8-a4fb-8c2fc3e181ed tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:07.796763 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-19c86a21-d338-4cd8-a4fb-8c2fc3e181ed tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:07.806510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4cf0889a-13c9-481e-bcbb-c59b5fd77204 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 14 microversion: 2.20 time: 0.114281 Dec 13 23:04:07.812034 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 102/201] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:07 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:07.814172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-19c86a21-d338-4cd8-a4fb-8c2fc3e181ed tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.814788 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-19c86a21-d338-4cd8-a4fb-8c2fc3e181ed tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.815673 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-19c86a21-d338-4cd8-a4fb-8c2fc3e181ed tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:07.816423 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-19c86a21-d338-4cd8-a4fb-8c2fc3e181ed tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:07.895636 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-19c86a21-d338-4cd8-a4fb-8c2fc3e181ed tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 14 microversion: 2.1 time: 0.103813 Dec 13 23:04:07.899726 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 100/202] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:07 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:08.291432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:08.292150 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:08.306718 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.307327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.308287 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.308877 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.397551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:08.398798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:08.407164 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.407702 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.410178 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.410837 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.522750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:08.531020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6eed6999-d1cf-40fa-9777-43767335de66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1318 microversion: 2.1 time: 0.243963 Dec 13 23:04:08.531821 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:08 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:08.596638 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:08.605640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-04ead6a6-ecf3-4e15-8c9d-e2cb36d9d896 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1553 microversion: 2.1 time: 0.212632 Dec 13 23:04:08.606388 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 101/204] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:08 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:08.820184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-febc0308-db86-4049-9741-22a38020e9bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:08.822100 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-febc0308-db86-4049-9741-22a38020e9bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:08.837154 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-febc0308-db86-4049-9741-22a38020e9bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.839410 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-febc0308-db86-4049-9741-22a38020e9bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.840596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-febc0308-db86-4049-9741-22a38020e9bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.841849 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-febc0308-db86-4049-9741-22a38020e9bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.906851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-97f31ccb-0257-4740-85d8-73bf0cd360d3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:08.907800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-97f31ccb-0257-4740-85d8-73bf0cd360d3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:08.915224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97f31ccb-0257-4740-85d8-73bf0cd360d3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.915894 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97f31ccb-0257-4740-85d8-73bf0cd360d3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.916891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97f31ccb-0257-4740-85d8-73bf0cd360d3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:08.917605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97f31ccb-0257-4740-85d8-73bf0cd360d3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:08.953159 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-febc0308-db86-4049-9741-22a38020e9bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 6451 microversion: 2.20 time: 0.136829 Dec 13 23:04:08.960667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 104/205] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:08 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 6451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:04:08.987273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-0e8d18ff-2da3-441e-83e8-594ac7dfe04d req-a7645a90-6308-4f8b-92ce-c546c3af35ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353b59fe-6794-411b-82f2-ac6f7dba75d4", "name": "network-vif-plugged", "status": "completed", "tag": "02ed001c-6e95-48af-96d5-9f200d0fb881"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:08.989813 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:08.989813 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:09.005649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-0e8d18ff-2da3-441e-83e8-594ac7dfe04d req-a7645a90-6308-4f8b-92ce-c546c3af35ba service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:09.008679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-0e8d18ff-2da3-441e-83e8-594ac7dfe04d req-a7645a90-6308-4f8b-92ce-c546c3af35ba service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:09.018294 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-97f31ccb-0257-4740-85d8-73bf0cd360d3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 6521 microversion: 2.1 time: 0.114960 Dec 13 23:04:09.019103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 102/206] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:08 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 6521 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:09.058120 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-0e8d18ff-2da3-441e-83e8-594ac7dfe04d req-a7645a90-6308-4f8b-92ce-c546c3af35ba service nova] Creating event network-vif-plugged:02ed001c-6e95-48af-96d5-9f200d0fb881 for instance 353b59fe-6794-411b-82f2-ac6f7dba75d4 on hv-cinder-79628 Dec 13 23:04:09.063800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-0e8d18ff-2da3-441e-83e8-594ac7dfe04d req-a7645a90-6308-4f8b-92ce-c546c3af35ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081440 Dec 13 23:04:09.064730 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 105/207] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:04:09.554788 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:09.557083 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:09.565635 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:09.566795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:09.567827 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:09.569278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:09.625235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:09.626107 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:09.638944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:09.639390 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:09.654404 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:09.655417 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:09.857705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:09.867345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d218ebc4-b47f-4c4c-a0fa-92cdef31b26b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1318 microversion: 2.1 time: 0.321382 Dec 13 23:04:09.878870 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 103/208] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:09 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:09.933574 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:09.949105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4d3e5bdb-36cd-4631-acd2-ef8e268fd07d tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1553 microversion: 2.1 time: 0.329414 Dec 13 23:04:09.950627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 106/209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:09 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:09.971192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a5bba49-c04e-419e-9d72-330feccf26af tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:09.974324 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6a5bba49-c04e-419e-9d72-330feccf26af tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:09.981179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a5bba49-c04e-419e-9d72-330feccf26af tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:09.981657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a5bba49-c04e-419e-9d72-330feccf26af tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:09.982445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a5bba49-c04e-419e-9d72-330feccf26af tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:09.982873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a5bba49-c04e-419e-9d72-330feccf26af tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:10.029835 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4038dbdf-ca46-4bbf-9fb5-3f4cb238441d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:10.030774 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4038dbdf-ca46-4bbf-9fb5-3f4cb238441d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:10.037532 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4038dbdf-ca46-4bbf-9fb5-3f4cb238441d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:10.038008 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4038dbdf-ca46-4bbf-9fb5-3f4cb238441d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:10.038771 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4038dbdf-ca46-4bbf-9fb5-3f4cb238441d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:10.039208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4038dbdf-ca46-4bbf-9fb5-3f4cb238441d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:10.075960 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a5bba49-c04e-419e-9d72-330feccf26af tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 9366 microversion: 2.20 time: 0.108877 Dec 13 23:04:10.076606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 104/210] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:09 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 9366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:04:10.143752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4038dbdf-ca46-4bbf-9fb5-3f4cb238441d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 10367 microversion: 2.1 time: 0.117495 Dec 13 23:04:10.144883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 107/211] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:10 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 10367 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:10.615749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-903873fa-db31-4b7c-a0c8-6d23e47a7255 req-8031b861-2adf-4ba9-86ff-78cd84771e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3b7009-1860-4939-a28b-e3d21862277b", "name": "network-vif-deleted", "tag": "d64c863f-3d75-442c-ae28-629a3af23ac4"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:10.617670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:10.617670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:04:10.627451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-903873fa-db31-4b7c-a0c8-6d23e47a7255 req-8031b861-2adf-4ba9-86ff-78cd84771e87 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:10.628334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-903873fa-db31-4b7c-a0c8-6d23e47a7255 req-8031b861-2adf-4ba9-86ff-78cd84771e87 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:10.639850 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-903873fa-db31-4b7c-a0c8-6d23e47a7255 req-8031b861-2adf-4ba9-86ff-78cd84771e87 service nova] Creating event network-vif-deleted:d64c863f-3d75-442c-ae28-629a3af23ac4 for instance 1e3b7009-1860-4939-a28b-e3d21862277b on hv-cinder-79628 Dec 13 23:04:10.644817 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-903873fa-db31-4b7c-a0c8-6d23e47a7255 req-8031b861-2adf-4ba9-86ff-78cd84771e87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 Dec 13 23:04:10.645444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 105/212] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:10.885012 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:10.885749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:10.893198 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:10.893678 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:10.894465 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:10.894904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:10.968816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:10.969730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:10.976541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:10.977099 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:10.977785 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:10.978215 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:11.132082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c506d63c763b40c3bbd2adfb3802433e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0804199575b2425fa1dad0bb783c4554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:11.140251 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2fce7d0b-4158-4d68-b467-575993bf8ea9 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 200 len: 1346 microversion: 2.1 time: 0.175888 Dec 13 23:04:11.146110 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 106/213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:10 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 1346 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:11.153893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d61174c9-0286-43f1-b268-53a002d16704 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:11.158984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d61174c9-0286-43f1-b268-53a002d16704 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:11.171473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61174c9-0286-43f1-b268-53a002d16704 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:11.174363 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61174c9-0286-43f1-b268-53a002d16704 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:11.175464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61174c9-0286-43f1-b268-53a002d16704 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:11.176276 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61174c9-0286-43f1-b268-53a002d16704 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:11.218916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:11.229572 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-80601485-4f20-4764-9300-f4eee45a2f69 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1318 microversion: 2.1 time: 0.348218 Dec 13 23:04:11.230895 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 108/214] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:10 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:11.236789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e6d937a5-debf-4fd7-bd16-cfeaf3a9fcb5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:11.242883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e6d937a5-debf-4fd7-bd16-cfeaf3a9fcb5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:11.250647 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d937a5-debf-4fd7-bd16-cfeaf3a9fcb5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:11.251371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d937a5-debf-4fd7-bd16-cfeaf3a9fcb5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:11.252642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d937a5-debf-4fd7-bd16-cfeaf3a9fcb5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:11.253303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d937a5-debf-4fd7-bd16-cfeaf3a9fcb5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:11.305517 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d61174c9-0286-43f1-b268-53a002d16704 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 13259 microversion: 2.20 time: 0.157258 Dec 13 23:04:11.307231 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 107/215] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:11 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 13259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:11.383641 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e6d937a5-debf-4fd7-bd16-cfeaf3a9fcb5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 13175 microversion: 2.1 time: 0.150578 Dec 13 23:04:11.389545 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 109/216] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:11 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 13175 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:12.164813 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:12.165444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:12.172555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.173000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.173799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.174220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.189656 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] HTTP exception thrown: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. Dec 13 23:04:12.190244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Returning 404 to user: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:04:12.191262 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e156876e-43ac-4b5f-93aa-8db56fd2bda3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 404 len: 111 microversion: 2.1 time: 0.030590 Dec 13 23:04:12.191841 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 108/217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:12 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:04:12.254988 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:12.255738 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:12.262747 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.263187 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.263953 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.264377 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.300387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:12.301311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:12.308529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.308978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.309808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.310240 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.325498 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] HTTP exception thrown: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. Dec 13 23:04:12.326104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Returning 404 to user: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:04:12.326958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-11a99051-5f69-4f06-9441-e946ba2b87c3 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030488 Dec 13 23:04:12.327527 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 109/218] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:04:12 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:04:12.332061 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a6dba0c5-6a62-4f74-a52f-9de0388e91ee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:12.333467 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a6dba0c5-6a62-4f74-a52f-9de0388e91ee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:12.339532 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6dba0c5-6a62-4f74-a52f-9de0388e91ee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.339985 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6dba0c5-6a62-4f74-a52f-9de0388e91ee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.340782 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6dba0c5-6a62-4f74-a52f-9de0388e91ee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.341219 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6dba0c5-6a62-4f74-a52f-9de0388e91ee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.411095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:12.418793 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-77c9625b-866d-4456-a9a8-384b0592f445 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1509 microversion: 2.1 time: 0.167823 Dec 13 23:04:12.419293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 110/219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:12 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:12.423663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ef094f63-ec6c-4430-8f7e-5942f9389d07 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:12.424746 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ef094f63-ec6c-4430-8f7e-5942f9389d07 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:12.431392 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef094f63-ec6c-4430-8f7e-5942f9389d07 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.431845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef094f63-ec6c-4430-8f7e-5942f9389d07 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.432641 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef094f63-ec6c-4430-8f7e-5942f9389d07 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.433077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef094f63-ec6c-4430-8f7e-5942f9389d07 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.458424 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a6dba0c5-6a62-4f74-a52f-9de0388e91ee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 16235 microversion: 2.20 time: 0.129436 Dec 13 23:04:12.459491 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 110/220] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:12 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 16235 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:12.466318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df26725c-483f-46fb-bc86-288b5968244d"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:12.467875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:12.476036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.476576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.477930 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.478497 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.530331 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ef094f63-ec6c-4430-8f7e-5942f9389d07 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 16486 microversion: 2.1 time: 0.109798 Dec 13 23:04:12.531471 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 111/221] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:12 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 16486 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:12.594667 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] HTTP exception thrown: Invalid volume: volume df26725c-483f-46fb-bc86-288b5968244d is already attached to instances: 50d21621-3cd9-4755-8588-0e8cb988d280 Dec 13 23:04:12.595268 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Returning 400 to user: Invalid volume: volume df26725c-483f-46fb-bc86-288b5968244d is already attached to instances: 50d21621-3cd9-4755-8588-0e8cb988d280 {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:04:12.596093 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-36748e0a-48dc-41b2-80d8-a162c9e58077 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135366 Dec 13 23:04:12.596846 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 111/222] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:04:12 2021] POST /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:04:12.829026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:12.829705 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:12.837787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.839108 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:12.840291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:12.840869 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.133066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lazy-loading 'services' on Instance uuid 50d21621-3cd9-4755-8588-0e8cb988d280 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:04:13.253217 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bec7b73f-daca-42e0-9e88-12f01a0b7247 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments/df26725c-483f-46fb-bc86-288b5968244d" status: 202 len: 0 microversion: 2.1 time: 0.428463 Dec 13 23:04:13.253881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 112/223] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:04:12 2021] DELETE /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments/df26725c-483f-46fb-bc86-288b5968244d => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:13.263067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ab5677a-b159-43c1-a6d8-fa9dd6bb1c41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:13.264769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ab5677a-b159-43c1-a6d8-fa9dd6bb1c41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:13.272047 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab5677a-b159-43c1-a6d8-fa9dd6bb1c41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.272899 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab5677a-b159-43c1-a6d8-fa9dd6bb1c41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.274106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab5677a-b159-43c1-a6d8-fa9dd6bb1c41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.274808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab5677a-b159-43c1-a6d8-fa9dd6bb1c41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.306380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ab5677a-b159-43c1-a6d8-fa9dd6bb1c41 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047481 Dec 13 23:04:13.306998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 112/224] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:04:13 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:13.472306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a30909e4-1807-4451-b796-ee9f2aa93c76 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:13.473284 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a30909e4-1807-4451-b796-ee9f2aa93c76 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:13.480113 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a30909e4-1807-4451-b796-ee9f2aa93c76 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.480583 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a30909e4-1807-4451-b796-ee9f2aa93c76 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.481447 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a30909e4-1807-4451-b796-ee9f2aa93c76 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.481905 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a30909e4-1807-4451-b796-ee9f2aa93c76 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.542210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:13.542914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:13.552489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.552997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.553803 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.554233 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.569125 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] HTTP exception thrown: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. Dec 13 23:04:13.569755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Returning 404 to user: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:04:13.569894 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a30909e4-1807-4451-b796-ee9f2aa93c76 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 17861 microversion: 2.20 time: 0.102146 Dec 13 23:04:13.571076 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 113/225] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:13 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 17861 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:13.573656 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-12293240-0e5e-4be7-b362-47b9bb721f2f tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 404 len: 111 microversion: 2.1 time: 0.034549 Dec 13 23:04:13.574257 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 113/226] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:04:13 2021] DELETE /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:04:13.578347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-51d23a26-1399-4c1f-b103-347d25ecbd4e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:13.579560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-51d23a26-1399-4c1f-b103-347d25ecbd4e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:13.582970 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:13.583745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] [instance: 1e3b7009-1860-4939-a28b-e3d21862277b] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:13.588580 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51d23a26-1399-4c1f-b103-347d25ecbd4e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.589224 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51d23a26-1399-4c1f-b103-347d25ecbd4e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.590000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.590439 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.590555 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51d23a26-1399-4c1f-b103-347d25ecbd4e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.591117 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51d23a26-1399-4c1f-b103-347d25ecbd4e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.591965 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:13.592406 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:13.606462 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] HTTP exception thrown: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. Dec 13 23:04:13.607182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] Returning 404 to user: Instance 1e3b7009-1860-4939-a28b-e3d21862277b could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:04:13.608081 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-94e94ff9-769f-4055-93cb-ed4be6c25587 tempest-DeleteServersTestJSON-400150828 tempest-DeleteServersTestJSON-400150828-project] 10.222.0.13 "GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b" status: 404 len: 111 microversion: 2.1 time: 0.029225 Dec 13 23:04:13.609043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 114/227] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:13 2021] GET /compute/v2.1/servers/1e3b7009-1860-4939-a28b-e3d21862277b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:04:13.698751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-51d23a26-1399-4c1f-b103-347d25ecbd4e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 17744 microversion: 2.1 time: 0.125595 Dec 13 23:04:13.699393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 114/228] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:13 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 17744 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:14.322974 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-485bdcbb-216e-41a8-a1a1-d66e9086a06a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:14.323944 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-485bdcbb-216e-41a8-a1a1-d66e9086a06a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:14.331509 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-485bdcbb-216e-41a8-a1a1-d66e9086a06a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:14.332179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-485bdcbb-216e-41a8-a1a1-d66e9086a06a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:14.334256 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-485bdcbb-216e-41a8-a1a1-d66e9086a06a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:14.334975 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-485bdcbb-216e-41a8-a1a1-d66e9086a06a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:14.374623 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-485bdcbb-216e-41a8-a1a1-d66e9086a06a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059601 Dec 13 23:04:14.375902 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 115/229] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:04:14 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:14.582698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ee984411-946e-4b80-ad78-14d877adae23 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:14.584245 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ee984411-946e-4b80-ad78-14d877adae23 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:14.599262 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee984411-946e-4b80-ad78-14d877adae23 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:14.600850 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee984411-946e-4b80-ad78-14d877adae23 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:14.602286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee984411-946e-4b80-ad78-14d877adae23 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:14.605951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee984411-946e-4b80-ad78-14d877adae23 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:14.635285 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-266559904", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "e25a0760-1b13-4e1d-bcac-3c85e52e485e"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:14.737821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] validate_networks() for [('e25a0760-1b13-4e1d-bcac-3c85e52e485e', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:04:14.751256 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ee984411-946e-4b80-ad78-14d877adae23 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 18449 microversion: 2.20 time: 0.172172 Dec 13 23:04:14.753193 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 115/230] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:14 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 18449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:14.763713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a9fc67d1-6096-4a10-9eae-f3bba83aae67 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:14.766822 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a9fc67d1-6096-4a10-9eae-f3bba83aae67 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:14.783819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9fc67d1-6096-4a10-9eae-f3bba83aae67 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:14.793685 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9fc67d1-6096-4a10-9eae-f3bba83aae67 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:14.797180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9fc67d1-6096-4a10-9eae-f3bba83aae67 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:14.799052 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9fc67d1-6096-4a10-9eae-f3bba83aae67 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:14.892901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a9fc67d1-6096-4a10-9eae-f3bba83aae67 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 18816 microversion: 2.1 time: 0.137619 Dec 13 23:04:14.894408 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 116/231] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:14 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 18816 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:15.267258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:04:15.267683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:04:15.268204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:04:15.268600 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:04:15.270565 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:04:15.280908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:15.281259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:15.284314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:15.284756 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:15.308778 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:04:15.313203 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for user 916e287d50864a638d3b1efe692e78e4 and project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:04:15.331989 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:04:15.335249 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:04:15.387501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-92eaed36-a051-48fc-b0d5-172a173cd1e5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757341 Dec 13 23:04:15.393479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 116/232] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:04:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 13 23:04:15.398939 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-eb91c3e2-076b-47c3-b72b-eeaa7d5adc16 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:15.404784 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-eb91c3e2-076b-47c3-b72b-eeaa7d5adc16 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:15.494494 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-eb91c3e2-076b-47c3-b72b-eeaa7d5adc16 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:15.502524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-eb91c3e2-076b-47c3-b72b-eeaa7d5adc16 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1217 microversion: 2.1 time: 0.106411 Dec 13 23:04:15.503089 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 117/233] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:15 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:15.766797 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c92921a2-1d84-4b1a-93be-05fc1b091bf7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:15.768356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c92921a2-1d84-4b1a-93be-05fc1b091bf7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:15.776689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c92921a2-1d84-4b1a-93be-05fc1b091bf7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:15.777817 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c92921a2-1d84-4b1a-93be-05fc1b091bf7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:15.779208 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c92921a2-1d84-4b1a-93be-05fc1b091bf7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:15.780144 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c92921a2-1d84-4b1a-93be-05fc1b091bf7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:15.896542 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c92921a2-1d84-4b1a-93be-05fc1b091bf7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 20691 microversion: 2.20 time: 0.134980 Dec 13 23:04:15.910052 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 117/234] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:15 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 20691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:15.910398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5ca00f78-b085-4cdc-858a-53140c6386dc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:15.913801 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5ca00f78-b085-4cdc-858a-53140c6386dc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:15.922310 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5ca00f78-b085-4cdc-858a-53140c6386dc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:15.923246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5ca00f78-b085-4cdc-858a-53140c6386dc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:15.924200 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5ca00f78-b085-4cdc-858a-53140c6386dc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:15.924841 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5ca00f78-b085-4cdc-858a-53140c6386dc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:16.025578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5ca00f78-b085-4cdc-858a-53140c6386dc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 20991 microversion: 2.1 time: 0.120945 Dec 13 23:04:16.026659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 118/235] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:15 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 20991 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:16.521318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:16.522259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:16.530887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:16.531927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:16.532713 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:16.533135 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:16.661693 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:16.672733 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b0cece3c-2a73-4f45-a070-c81e88f654a2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1269 microversion: 2.1 time: 0.156170 Dec 13 23:04:16.674286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 118/236] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:16 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:16.910403 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a4d73b9a-5c8d-44f0-bd25-46ec7b3ec214 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:16.911463 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a4d73b9a-5c8d-44f0-bd25-46ec7b3ec214 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:16.930547 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4d73b9a-5c8d-44f0-bd25-46ec7b3ec214 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:16.932738 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4d73b9a-5c8d-44f0-bd25-46ec7b3ec214 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:16.934049 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4d73b9a-5c8d-44f0-bd25-46ec7b3ec214 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:16.934596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4d73b9a-5c8d-44f0-bd25-46ec7b3ec214 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:17.037578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a4d73b9a-5c8d-44f0-bd25-46ec7b3ec214 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 22266 microversion: 2.20 time: 0.131070 Dec 13 23:04:17.038611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 119/237] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:16 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 22266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:17.048957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-049c24ce-26c7-4b72-a636-b7a938d0ab5f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:17.052861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-049c24ce-26c7-4b72-a636-b7a938d0ab5f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:17.059717 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-049c24ce-26c7-4b72-a636-b7a938d0ab5f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:17.060222 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-049c24ce-26c7-4b72-a636-b7a938d0ab5f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:17.061236 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-049c24ce-26c7-4b72-a636-b7a938d0ab5f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:17.061868 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-049c24ce-26c7-4b72-a636-b7a938d0ab5f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:17.155179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-049c24ce-26c7-4b72-a636-b7a938d0ab5f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 22488 microversion: 2.1 time: 0.118519 Dec 13 23:04:17.156206 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 119/238] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:17 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 22488 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:17.693116 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:17.693958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:17.701949 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:17.702529 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:17.703584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:17.704109 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:17.772586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:17.780571 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8759a78f-64cf-47a7-9b14-742b51c18822 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1275 microversion: 2.1 time: 0.092234 Dec 13 23:04:17.781121 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 120/239] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:17 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:18.050146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-75636021-4761-4996-965e-065caa7a87ef tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:18.051685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-75636021-4761-4996-965e-065caa7a87ef tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:18.060870 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75636021-4761-4996-965e-065caa7a87ef tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:18.061799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75636021-4761-4996-965e-065caa7a87ef tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:18.062785 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75636021-4761-4996-965e-065caa7a87ef tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:18.063380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-75636021-4761-4996-965e-065caa7a87ef tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:18.151263 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-75636021-4761-4996-965e-065caa7a87ef tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 23601 microversion: 2.20 time: 0.106251 Dec 13 23:04:18.155209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 120/240] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:18 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 23601 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:04:18.166064 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-aa717422-d871-4c7c-a54d-3066504c8f16 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:18.167174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-aa717422-d871-4c7c-a54d-3066504c8f16 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:18.173582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa717422-d871-4c7c-a54d-3066504c8f16 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:18.174095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa717422-d871-4c7c-a54d-3066504c8f16 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:18.175108 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa717422-d871-4c7c-a54d-3066504c8f16 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:18.175605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa717422-d871-4c7c-a54d-3066504c8f16 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:18.266720 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-aa717422-d871-4c7c-a54d-3066504c8f16 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 23798 microversion: 2.1 time: 0.104311 Dec 13 23:04:18.270793 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 121/241] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:18 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 23798 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:18.798338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:18.799056 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:18.806836 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:18.807575 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:18.808432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:18.808929 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:18.969187 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:18.978414 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f887fe49-6a43-4bbb-84c0-fd167a6de434 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.183962 Dec 13 23:04:18.978982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 121/242] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:18 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:19.164533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e6d47746-4d97-4ac3-8fc7-45905cb22519 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:19.166523 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e6d47746-4d97-4ac3-8fc7-45905cb22519 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:19.174495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d47746-4d97-4ac3-8fc7-45905cb22519 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:19.175106 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d47746-4d97-4ac3-8fc7-45905cb22519 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:19.176327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d47746-4d97-4ac3-8fc7-45905cb22519 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:19.177628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e6d47746-4d97-4ac3-8fc7-45905cb22519 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:19.264409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e6d47746-4d97-4ac3-8fc7-45905cb22519 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 24430 microversion: 2.20 time: 0.104905 Dec 13 23:04:19.265051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 122/243] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:19 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 24430 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:19.278054 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b20593c7-31c7-4122-9559-31821da86fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:19.279201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b20593c7-31c7-4122-9559-31821da86fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:19.285821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b20593c7-31c7-4122-9559-31821da86fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:19.286344 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b20593c7-31c7-4122-9559-31821da86fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:19.287241 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b20593c7-31c7-4122-9559-31821da86fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:19.287613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b20593c7-31c7-4122-9559-31821da86fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:19.382878 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b20593c7-31c7-4122-9559-31821da86fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 24463 microversion: 2.1 time: 0.107861 Dec 13 23:04:19.383775 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 122/244] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:19 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 24463 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:19.444498 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-8fe55922-531a-49b2-90fe-28bf6945d017 req-5752710b-266f-4609-84b1-8ab278371645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66106e4e-2ac2-4866-a07d-20f05ada9bf8", "tag": "f7385e78-ed70-42a9-bf3a-1245a3993ec0"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:19.446838 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:19.446838 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:19.471109 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-8fe55922-531a-49b2-90fe-28bf6945d017 req-5752710b-266f-4609-84b1-8ab278371645 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:19.471620 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-8fe55922-531a-49b2-90fe-28bf6945d017 req-5752710b-266f-4609-84b1-8ab278371645 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:19.487832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-8fe55922-531a-49b2-90fe-28bf6945d017 req-5752710b-266f-4609-84b1-8ab278371645 service nova] Creating event network-changed:f7385e78-ed70-42a9-bf3a-1245a3993ec0 for instance 66106e4e-2ac2-4866-a07d-20f05ada9bf8 on hv-cinder-79628 Dec 13 23:04:19.494697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-8fe55922-531a-49b2-90fe-28bf6945d017 req-5752710b-266f-4609-84b1-8ab278371645 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059605 Dec 13 23:04:19.495363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 123/245] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:19.998881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:19.999769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:20.008146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:20.008959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:20.009996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:20.010494 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:20.165037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:20.174340 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a44857d-eebe-4247-9aec-a30aee02776a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.179600 Dec 13 23:04:20.182127 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 123/246] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:19 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:20.280373 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9be1167d-412f-470c-893f-d504920e4c4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:20.282924 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9be1167d-412f-470c-893f-d504920e4c4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:20.300731 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9be1167d-412f-470c-893f-d504920e4c4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:20.301278 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9be1167d-412f-470c-893f-d504920e4c4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:20.303036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9be1167d-412f-470c-893f-d504920e4c4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:20.304021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9be1167d-412f-470c-893f-d504920e4c4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:20.395604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-361c15a3-b06d-4652-8946-699b438f1ef4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:20.398073 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-361c15a3-b06d-4652-8946-699b438f1ef4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:20.418308 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9be1167d-412f-470c-893f-d504920e4c4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 25194 microversion: 2.20 time: 0.137014 Dec 13 23:04:20.426293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 124/247] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:20 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 25194 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:20.456403 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-361c15a3-b06d-4652-8946-699b438f1ef4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:20.456940 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-361c15a3-b06d-4652-8946-699b438f1ef4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:20.458393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-361c15a3-b06d-4652-8946-699b438f1ef4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:20.458844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-361c15a3-b06d-4652-8946-699b438f1ef4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:20.623151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-361c15a3-b06d-4652-8946-699b438f1ef4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 25562 microversion: 2.1 time: 0.231383 Dec 13 23:04:20.624963 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 124/248] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:20 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 25562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:21.192491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:21.193610 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:21.208234 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:21.209555 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:21.211238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:21.211238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:21.434094 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bb8decc3-63a7-4cdf-92f9-fa53f4f3c012 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:21.435738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bb8decc3-63a7-4cdf-92f9-fa53f4f3c012 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:21.451095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb8decc3-63a7-4cdf-92f9-fa53f4f3c012 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:21.451553 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb8decc3-63a7-4cdf-92f9-fa53f4f3c012 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:21.459558 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb8decc3-63a7-4cdf-92f9-fa53f4f3c012 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:21.460027 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb8decc3-63a7-4cdf-92f9-fa53f4f3c012 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:21.566490 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bb8decc3-63a7-4cdf-92f9-fa53f4f3c012 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 25996 microversion: 2.20 time: 0.139190 Dec 13 23:04:21.567450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 125/249] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:21 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 25996 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:04:21.639212 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:21.653881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fe909b37-731b-4cbc-a428-319344f0c2f1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:21.656731 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fe909b37-731b-4cbc-a428-319344f0c2f1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:21.668098 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4ce0eb26-6127-4e65-b583-8a553b3a3326 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.479647 Dec 13 23:04:21.680553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 125/250] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:21 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:21.680745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fe909b37-731b-4cbc-a428-319344f0c2f1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:21.680745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fe909b37-731b-4cbc-a428-319344f0c2f1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:21.680745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fe909b37-731b-4cbc-a428-319344f0c2f1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:21.680745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fe909b37-731b-4cbc-a428-319344f0c2f1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:21.790399 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fe909b37-731b-4cbc-a428-319344f0c2f1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 26237 microversion: 2.1 time: 0.156299 Dec 13 23:04:21.794296 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 126/251] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:21 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 26237 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:22.579478 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0df8e98c-4881-4e6a-a44e-a365cd342be6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:22.580408 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0df8e98c-4881-4e6a-a44e-a365cd342be6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:22.594791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0df8e98c-4881-4e6a-a44e-a365cd342be6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:22.595246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0df8e98c-4881-4e6a-a44e-a365cd342be6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:22.596049 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0df8e98c-4881-4e6a-a44e-a365cd342be6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:22.596869 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0df8e98c-4881-4e6a-a44e-a365cd342be6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:22.697228 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0df8e98c-4881-4e6a-a44e-a365cd342be6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 26953 microversion: 2.20 time: 0.121494 Dec 13 23:04:22.698481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 126/252] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:22 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 26953 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:22.700140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:22.701736 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:22.712230 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:22.713002 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:22.714274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:22.714895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:22.805724 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-41797c64-4fea-4a84-b7f2-40df61864f1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:22.807101 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-41797c64-4fea-4a84-b7f2-40df61864f1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:22.821648 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41797c64-4fea-4a84-b7f2-40df61864f1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:22.822105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41797c64-4fea-4a84-b7f2-40df61864f1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:22.822909 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41797c64-4fea-4a84-b7f2-40df61864f1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:22.825326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41797c64-4fea-4a84-b7f2-40df61864f1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:22.924517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-41797c64-4fea-4a84-b7f2-40df61864f1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 27089 microversion: 2.1 time: 0.123651 Dec 13 23:04:22.925178 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 127/253] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:22 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 27089 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:04:23.016483 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:23.026425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4e771aac-784a-41f1-ba70-8630aa5ba1e3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.335871 Dec 13 23:04:23.031368 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 127/254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:22 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:23.394880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-555319949", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f2efc7b-113a-43a4-800b-1debb6310f72"}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:23.483370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] validate_networks() for [('5f2efc7b-113a-43a4-800b-1debb6310f72', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:04:23.710107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1ddfc905-2483-44d5-a54b-b310597c5ddf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:23.711824 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1ddfc905-2483-44d5-a54b-b310597c5ddf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:23.722373 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ddfc905-2483-44d5-a54b-b310597c5ddf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:23.722828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ddfc905-2483-44d5-a54b-b310597c5ddf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:23.729826 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ddfc905-2483-44d5-a54b-b310597c5ddf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:23.730310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1ddfc905-2483-44d5-a54b-b310597c5ddf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:23.844768 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1ddfc905-2483-44d5-a54b-b310597c5ddf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 27513 microversion: 2.20 time: 0.139129 Dec 13 23:04:23.849224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 128/255] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:23 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 27513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:23.936726 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-42f80e37-8d92-4c23-995f-467271e08407 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:23.937773 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-42f80e37-8d92-4c23-995f-467271e08407 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:23.952016 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42f80e37-8d92-4c23-995f-467271e08407 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:23.952681 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42f80e37-8d92-4c23-995f-467271e08407 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:23.954019 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42f80e37-8d92-4c23-995f-467271e08407 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:23.955091 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42f80e37-8d92-4c23-995f-467271e08407 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:24.100227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-42f80e37-8d92-4c23-995f-467271e08407 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 27608 microversion: 2.1 time: 0.167384 Dec 13 23:04:24.101321 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 129/256] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:23 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 27608 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:04:24.110122 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:24.112804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:24.128792 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:24.129893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:24.131115 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:24.132163 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:24.366235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:04:24.372831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:04:24.378887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:04:24.379295 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:04:24.379801 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:04:24.402711 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:24.403179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:24.408459 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:24.408914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:24.442476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:24.450275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-34d13155-784d-4dab-b729-141bc699aef0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.347504 Dec 13 23:04:24.450857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 130/257] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:24 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:24.454321 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Getting quotas for project f78a3c42585545bcb350232445d77600. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:04:24.466550 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Getting quotas for user 8b353b88c68b4f13809be4cf726facd1 and project f78a3c42585545bcb350232445d77600. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:04:24.480014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:04:24.482981 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:04:24.563046 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d19ce4b5-f53b-468f-810c-c00c3e98a8ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.511356 Dec 13 23:04:24.566219 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 128/258] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:04:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:04:24.576757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-96fb3038-a848-4624-9a0c-66dfce8e32f9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:24.577953 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-96fb3038-a848-4624-9a0c-66dfce8e32f9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:24.674843 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-96fb3038-a848-4624-9a0c-66dfce8e32f9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:24.691865 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-96fb3038-a848-4624-9a0c-66dfce8e32f9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1221 microversion: 2.1 time: 0.116795 Dec 13 23:04:24.691865 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 131/259] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:24 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:24.853973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1792614617", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f2efc7b-113a-43a4-800b-1debb6310f72"}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:24.856167 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a2a38ca2-b524-4d24-9319-14461d834111 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:24.857080 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a2a38ca2-b524-4d24-9319-14461d834111 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:24.864612 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a38ca2-b524-4d24-9319-14461d834111 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:24.865057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a38ca2-b524-4d24-9319-14461d834111 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:24.865874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a38ca2-b524-4d24-9319-14461d834111 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:24.870461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2a38ca2-b524-4d24-9319-14461d834111 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:24.917902 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] validate_networks() for [('5f2efc7b-113a-43a4-800b-1debb6310f72', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:04:24.987309 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a2a38ca2-b524-4d24-9319-14461d834111 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 27837 microversion: 2.20 time: 0.134625 Dec 13 23:04:24.993687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 132/260] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:24 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 27837 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:04:25.112625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-abb26683-02aa-4dce-927c-0a5102bc7f5c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:25.114419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-abb26683-02aa-4dce-927c-0a5102bc7f5c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:25.130836 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-abb26683-02aa-4dce-927c-0a5102bc7f5c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:25.132350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-abb26683-02aa-4dce-927c-0a5102bc7f5c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:25.133828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-abb26683-02aa-4dce-927c-0a5102bc7f5c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:25.135058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-abb26683-02aa-4dce-927c-0a5102bc7f5c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:25.300975 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-abb26683-02aa-4dce-927c-0a5102bc7f5c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 27920 microversion: 2.1 time: 0.192300 Dec 13 23:04:25.302760 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 133/261] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:25 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 27920 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:04:25.469966 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:25.470682 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:25.484645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:25.485165 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:25.486022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:25.486460 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:25.626706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:04:25.627204 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:04:25.627598 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:04:25.628005 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:04:25.628411 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:04:25.649721 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:25.652130 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:25.657089 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:25.660143 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:25.707531 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Getting quotas for project f78a3c42585545bcb350232445d77600. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:04:25.726138 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Getting quotas for user 8b353b88c68b4f13809be4cf726facd1 and project f78a3c42585545bcb350232445d77600. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:04:25.765123 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:04:25.769361 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:04:25.816570 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:25.828026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7800d4d9-a87e-4210-bd90-71ad039a61b2 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.361239 Dec 13 23:04:25.829040 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 134/262] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:25 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:25.833971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-73526ed9-9269-4802-a576-fab8c2015431 req-9a86c848-347f-47a8-890b-f6a620ce25cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66106e4e-2ac2-4866-a07d-20f05ada9bf8", "name": "network-vif-plugged", "status": "completed", "tag": "f7385e78-ed70-42a9-bf3a-1245a3993ec0"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:25.835782 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:25.835782 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:04:25.844598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-73526ed9-9269-4802-a576-fab8c2015431 req-9a86c848-347f-47a8-890b-f6a620ce25cb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:25.845257 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-73526ed9-9269-4802-a576-fab8c2015431 req-9a86c848-347f-47a8-890b-f6a620ce25cb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:25.856460 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-73526ed9-9269-4802-a576-fab8c2015431 req-9a86c848-347f-47a8-890b-f6a620ce25cb service nova] Creating event network-vif-plugged:f7385e78-ed70-42a9-bf3a-1245a3993ec0 for instance 66106e4e-2ac2-4866-a07d-20f05ada9bf8 on hv-cinder-79628 Dec 13 23:04:25.862682 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-73526ed9-9269-4802-a576-fab8c2015431 req-9a86c848-347f-47a8-890b-f6a620ce25cb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032104 Dec 13 23:04:25.864082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 135/263] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:25.895116 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-66c998e9-7ce6-4513-826e-9b931f9aef17 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.043076 Dec 13 23:04:25.900926 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 129/264] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:04:24 2021] POST /compute/v2.1/servers => generated 383 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:04:25.914840 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c2907421-04ae-4ef6-b079-007dc2a88a47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:25.918014 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c2907421-04ae-4ef6-b079-007dc2a88a47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:26.005759 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e1629295-6a45-45bc-b999-afd33494e7c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:26.007891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e1629295-6a45-45bc-b999-afd33494e7c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:26.034893 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e1629295-6a45-45bc-b999-afd33494e7c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:26.039637 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e1629295-6a45-45bc-b999-afd33494e7c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:26.049629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e1629295-6a45-45bc-b999-afd33494e7c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:26.050689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e1629295-6a45-45bc-b999-afd33494e7c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:26.078125 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c2907421-04ae-4ef6-b079-007dc2a88a47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:26.087283 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c2907421-04ae-4ef6-b079-007dc2a88a47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1222 microversion: 2.1 time: 0.184968 Dec 13 23:04:26.096968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 136/265] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:25 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1222 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:26.227920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e1629295-6a45-45bc-b999-afd33494e7c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28186 microversion: 2.20 time: 0.230726 Dec 13 23:04:26.229384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 130/266] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:25 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28186 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:26.315030 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3de854ed-f7aa-4167-a5f7-8121cfb92b87 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:26.316293 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3de854ed-f7aa-4167-a5f7-8121cfb92b87 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:26.331186 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3de854ed-f7aa-4167-a5f7-8121cfb92b87 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:26.332888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3de854ed-f7aa-4167-a5f7-8121cfb92b87 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:26.340314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3de854ed-f7aa-4167-a5f7-8121cfb92b87 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:26.345099 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3de854ed-f7aa-4167-a5f7-8121cfb92b87 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:26.848084 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:26.849367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:26.856289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:26.857068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:26.858449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:26.859267 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:27.082499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:27.095527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a4cedc44-bc54-48f3-b278-e35b3daf159f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.250776 Dec 13 23:04:27.106298 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 131/267] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:26 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:27.117962 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:27.119931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:27.132721 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:27.136138 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:27.139500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:27.141485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:27.247686 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:27.256635 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-25beab33-12c7-4f22-9108-69f08f39c23d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1226 microversion: 2.1 time: 0.149165 Dec 13 23:04:27.258054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 132/268] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:27 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:27.271274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2de6862e-cf93-443a-98c7-b9e816fc7eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:27.272591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2de6862e-cf93-443a-98c7-b9e816fc7eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:27.279055 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2de6862e-cf93-443a-98c7-b9e816fc7eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:27.280374 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2de6862e-cf93-443a-98c7-b9e816fc7eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:27.281158 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2de6862e-cf93-443a-98c7-b9e816fc7eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:27.281811 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2de6862e-cf93-443a-98c7-b9e816fc7eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:29.465551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3de854ed-f7aa-4167-a5f7-8121cfb92b87 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28156 microversion: 2.1 time: 3.154328 Dec 13 23:04:29.466448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 137/269] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:26 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28156 bytes in 3157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:29.472074 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:29.472960 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:29.481003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:29.481512 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:29.482689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:29.482689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:29.508843 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2de6862e-cf93-443a-98c7-b9e816fc7eee tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28186 microversion: 2.20 time: 2.245636 Dec 13 23:04:29.509506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 133/270] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:27 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28186 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:29.518312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:29.519010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:29.529289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:29.529757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:29.530637 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:29.531062 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:29.616523 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:29.627159 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a9deddda-22df-4064-a9e1-51011170d788 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1226 microversion: 2.1 time: 0.112635 Dec 13 23:04:29.628344 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 134/271] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:29 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:29.660748 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:29.668320 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ab308a9-4b25-415d-85f3-4473f57bcac9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.200608 Dec 13 23:04:29.668889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 138/272] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:29 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:30.155362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-57fd2839-6f65-4b9e-8ebd-d0a1bb65d482 req-2a2b0298-6b56-4577-80fa-4f1b153c643c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f930f2d2-ece8-408b-aad2-fcb48bac226d", "tag": "ceceea56-a83b-49e0-812f-5e242b04cd78"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:30.157377 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:30.157377 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:30.166785 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-57fd2839-6f65-4b9e-8ebd-d0a1bb65d482 req-2a2b0298-6b56-4577-80fa-4f1b153c643c service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.167347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-57fd2839-6f65-4b9e-8ebd-d0a1bb65d482 req-2a2b0298-6b56-4577-80fa-4f1b153c643c service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.189168 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-57fd2839-6f65-4b9e-8ebd-d0a1bb65d482 req-2a2b0298-6b56-4577-80fa-4f1b153c643c service nova] Creating event network-changed:ceceea56-a83b-49e0-812f-5e242b04cd78 for instance f930f2d2-ece8-408b-aad2-fcb48bac226d on hv-cinder-79628 Dec 13 23:04:30.194220 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-57fd2839-6f65-4b9e-8ebd-d0a1bb65d482 req-2a2b0298-6b56-4577-80fa-4f1b153c643c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043922 Dec 13 23:04:30.194768 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 135/273] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:30.477448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-60ed0f14-5744-42b8-be9b-c6bd29722990 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:30.479389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-60ed0f14-5744-42b8-be9b-c6bd29722990 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:30.487857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60ed0f14-5744-42b8-be9b-c6bd29722990 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.488315 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60ed0f14-5744-42b8-be9b-c6bd29722990 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.490167 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60ed0f14-5744-42b8-be9b-c6bd29722990 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.491595 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60ed0f14-5744-42b8-be9b-c6bd29722990 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.533187 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-de509149-d562-4c8a-816d-cca3b1361f2e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:30.546333 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-de509149-d562-4c8a-816d-cca3b1361f2e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:30.564962 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-de509149-d562-4c8a-816d-cca3b1361f2e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.567708 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-de509149-d562-4c8a-816d-cca3b1361f2e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.568789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-de509149-d562-4c8a-816d-cca3b1361f2e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.571245 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-de509149-d562-4c8a-816d-cca3b1361f2e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.603812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-60ed0f14-5744-42b8-be9b-c6bd29722990 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28156 microversion: 2.1 time: 0.130073 Dec 13 23:04:30.605068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 139/274] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:30 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28156 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:30.648618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:30.649900 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:30.670597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.673728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.676489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.678839 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.722485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-de509149-d562-4c8a-816d-cca3b1361f2e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28186 microversion: 2.20 time: 0.205674 Dec 13 23:04:30.727264 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 136/275] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:30 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28186 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:30.741295 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:30.742194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:30.760021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.760469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.761265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:30.767409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:30.782979 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:30.804197 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-59849f60-d344-4ec9-84ef-b3f0c905250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1280 microversion: 2.1 time: 0.159772 Dec 13 23:04:30.816356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 140/276] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:30 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:31.045977 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:31.060265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bc9fa8e1-bf43-4747-8437-fe993e3cd21a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1317 microversion: 2.1 time: 0.330119 Dec 13 23:04:31.061230 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 137/277] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:30 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:31.617825 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ef821498-2e56-43e8-956f-fb5387406fe7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:31.619577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ef821498-2e56-43e8-956f-fb5387406fe7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:31.629266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef821498-2e56-43e8-956f-fb5387406fe7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:31.630026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef821498-2e56-43e8-956f-fb5387406fe7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:31.631833 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef821498-2e56-43e8-956f-fb5387406fe7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:31.632748 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ef821498-2e56-43e8-956f-fb5387406fe7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:31.735220 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ffa079b7-ed8d-4e98-838e-8056a47db9b7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:31.736253 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ffa079b7-ed8d-4e98-838e-8056a47db9b7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:31.743655 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ef821498-2e56-43e8-956f-fb5387406fe7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28188 microversion: 2.1 time: 0.130740 Dec 13 23:04:31.745475 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 141/278] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:31 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:31.745649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ffa079b7-ed8d-4e98-838e-8056a47db9b7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:31.746350 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ffa079b7-ed8d-4e98-838e-8056a47db9b7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:31.747149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ffa079b7-ed8d-4e98-838e-8056a47db9b7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:31.747576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ffa079b7-ed8d-4e98-838e-8056a47db9b7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:31.823732 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:31.824705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:31.836033 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:31.836947 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:31.838306 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:31.839045 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:31.844415 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ffa079b7-ed8d-4e98-838e-8056a47db9b7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28201 microversion: 2.20 time: 0.113365 Dec 13 23:04:31.845174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 138/279] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:31 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28201 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:04:32.077570 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:32.078270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:32.085513 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:32.085967 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:32.086796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:32.087167 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:32.089380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:32.100209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dbdd3c3f-d2ea-4b8e-8bea-c6e53fffc2f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1322 microversion: 2.1 time: 0.281547 Dec 13 23:04:32.111267 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 142/280] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:31 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:32.320573 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:32.331065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-689062ae-a733-4018-aa61-709a3cb8d6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1508 microversion: 2.1 time: 0.257606 Dec 13 23:04:32.331634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 139/281] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:32 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:32.478511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-36265ec6-d4e1-42eb-8254-c00850aba9a0 req-57c2fbda-4473-479b-bf23-5d961fe43ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad7412a-5ada-4048-a735-b557f4868be5", "tag": "64ee4b02-4e4c-45cd-af6e-2d1e7a92f1e9"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:32.483854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:32.483854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:04:32.499386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-36265ec6-d4e1-42eb-8254-c00850aba9a0 req-57c2fbda-4473-479b-bf23-5d961fe43ef0 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:32.499951 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-36265ec6-d4e1-42eb-8254-c00850aba9a0 req-57c2fbda-4473-479b-bf23-5d961fe43ef0 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:32.513133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-36265ec6-d4e1-42eb-8254-c00850aba9a0 req-57c2fbda-4473-479b-bf23-5d961fe43ef0 service nova] Creating event network-changed:64ee4b02-4e4c-45cd-af6e-2d1e7a92f1e9 for instance 8ad7412a-5ada-4048-a735-b557f4868be5 on hv-cinder-79628 Dec 13 23:04:32.518840 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-36265ec6-d4e1-42eb-8254-c00850aba9a0 req-57c2fbda-4473-479b-bf23-5d961fe43ef0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050604 Dec 13 23:04:32.519479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 143/282] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:32.756545 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2429e0f7-b0df-4bdd-b48f-7919fd34f497 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:32.757580 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2429e0f7-b0df-4bdd-b48f-7919fd34f497 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:32.763850 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2429e0f7-b0df-4bdd-b48f-7919fd34f497 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:32.764293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2429e0f7-b0df-4bdd-b48f-7919fd34f497 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:32.765082 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2429e0f7-b0df-4bdd-b48f-7919fd34f497 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:32.765560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2429e0f7-b0df-4bdd-b48f-7919fd34f497 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:32.859027 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bdb45589-fc07-4c64-a16f-e95524961fd5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:32.860059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bdb45589-fc07-4c64-a16f-e95524961fd5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:32.867343 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bdb45589-fc07-4c64-a16f-e95524961fd5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:32.867534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2429e0f7-b0df-4bdd-b48f-7919fd34f497 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28443 microversion: 2.1 time: 0.114975 Dec 13 23:04:32.867798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bdb45589-fc07-4c64-a16f-e95524961fd5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:32.868479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 140/283] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:32 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28443 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:32.868614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bdb45589-fc07-4c64-a16f-e95524961fd5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:32.869033 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bdb45589-fc07-4c64-a16f-e95524961fd5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:32.963780 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bdb45589-fc07-4c64-a16f-e95524961fd5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28475 microversion: 2.20 time: 0.110886 Dec 13 23:04:32.964460 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 144/284] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:32 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28475 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:04:33.124921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:33.125814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:33.135499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:33.136201 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:33.137459 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:33.138626 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:33.420401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:33.430585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-834891c9-a6dc-4d04-b3d5-5934b542ed01 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1322 microversion: 2.1 time: 0.315529 Dec 13 23:04:33.431432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 141/285] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:33 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:33.705258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8363982f-a413-4ff4-a5e5-89be014fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f602ef42-2923-4311-a21f-8329c6f93135"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:33.706672 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8363982f-a413-4ff4-a5e5-89be014fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:33.713754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8363982f-a413-4ff4-a5e5-89be014fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:33.714191 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8363982f-a413-4ff4-a5e5-89be014fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:33.714973 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8363982f-a413-4ff4-a5e5-89be014fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:33.715399 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8363982f-a413-4ff4-a5e5-89be014fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:33.880155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-47c0569d-93c7-4a15-b586-6f99458022b1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:33.881063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-47c0569d-93c7-4a15-b586-6f99458022b1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:33.890296 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47c0569d-93c7-4a15-b586-6f99458022b1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:33.890741 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47c0569d-93c7-4a15-b586-6f99458022b1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:33.891613 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47c0569d-93c7-4a15-b586-6f99458022b1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:33.892035 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47c0569d-93c7-4a15-b586-6f99458022b1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:34.041596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-47c0569d-93c7-4a15-b586-6f99458022b1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28611 microversion: 2.1 time: 0.165358 Dec 13 23:04:34.042226 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8363982f-a413-4ff4-a5e5-89be014fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340894 Dec 13 23:04:34.046519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 142/286] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:33 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28611 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:34.046637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 145/287] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:04:33 2021] POST /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:04:34.048525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ae4f9976-3814-48c2-982c-940399124c9d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:34.050279 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ae4f9976-3814-48c2-982c-940399124c9d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:34.058576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae4f9976-3814-48c2-982c-940399124c9d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:34.059226 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae4f9976-3814-48c2-982c-940399124c9d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:34.060149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae4f9976-3814-48c2-982c-940399124c9d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:34.060642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae4f9976-3814-48c2-982c-940399124c9d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:34.168719 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ae4f9976-3814-48c2-982c-940399124c9d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28641 microversion: 2.20 time: 0.124391 Dec 13 23:04:34.169383 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 143/288] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:34 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28641 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:34.448926 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:34.450286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:34.456714 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:34.457270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:34.458301 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:34.458948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:34.628684 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:34.650862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-18392680-2430-43fd-ab68-f1bba3d178a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1322 microversion: 2.1 time: 0.206721 Dec 13 23:04:34.651463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 146/289] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:34 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:35.055975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-70545dd7-5059-41b4-b8ad-a458090bd1f7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:35.057132 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-70545dd7-5059-41b4-b8ad-a458090bd1f7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:35.064211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-70545dd7-5059-41b4-b8ad-a458090bd1f7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:35.064669 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-70545dd7-5059-41b4-b8ad-a458090bd1f7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:35.065481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-70545dd7-5059-41b4-b8ad-a458090bd1f7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:35.065958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-70545dd7-5059-41b4-b8ad-a458090bd1f7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:35.155114 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-70545dd7-5059-41b4-b8ad-a458090bd1f7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28611 microversion: 2.1 time: 0.104451 Dec 13 23:04:35.157755 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 144/290] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:35 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28611 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:35.187591 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-55af4602-266b-448d-934f-8d1d023c88c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:35.188575 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-55af4602-266b-448d-934f-8d1d023c88c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:35.197369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55af4602-266b-448d-934f-8d1d023c88c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:35.198217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55af4602-266b-448d-934f-8d1d023c88c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:35.199355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55af4602-266b-448d-934f-8d1d023c88c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:35.200001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55af4602-266b-448d-934f-8d1d023c88c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:35.418340 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-55af4602-266b-448d-934f-8d1d023c88c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28641 microversion: 2.20 time: 0.241771 Dec 13 23:04:35.419127 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 147/291] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:35 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28641 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:35.547801 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-07a7fcc1-2912-41dd-b9e4-0397096d1fc2 req-bab1dbc2-492a-43d3-a871-25006093b488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f930f2d2-ece8-408b-aad2-fcb48bac226d", "name": "network-vif-plugged", "status": "completed", "tag": "ceceea56-a83b-49e0-812f-5e242b04cd78"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:35.552808 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:35.552808 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:35.563703 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-07a7fcc1-2912-41dd-b9e4-0397096d1fc2 req-bab1dbc2-492a-43d3-a871-25006093b488 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:35.564184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-07a7fcc1-2912-41dd-b9e4-0397096d1fc2 req-bab1dbc2-492a-43d3-a871-25006093b488 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:35.582438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-07a7fcc1-2912-41dd-b9e4-0397096d1fc2 req-bab1dbc2-492a-43d3-a871-25006093b488 service nova] Creating event network-vif-plugged:ceceea56-a83b-49e0-812f-5e242b04cd78 for instance f930f2d2-ece8-408b-aad2-fcb48bac226d on hv-cinder-79628 Dec 13 23:04:35.587531 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-07a7fcc1-2912-41dd-b9e4-0397096d1fc2 req-bab1dbc2-492a-43d3-a871-25006093b488 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051149 Dec 13 23:04:35.588391 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 145/292] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:35.668550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:35.669613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:35.683865 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:35.684331 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:35.686067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:35.686582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:35.953116 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:35.962103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-27c3c0d8-8895-4c6a-accc-51f043a58ad5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1322 microversion: 2.1 time: 0.297415 Dec 13 23:04:35.972201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 148/293] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:35 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:36.168408 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8cc83ded-7b52-4d0c-a3e1-0e0742774310 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:36.169600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8cc83ded-7b52-4d0c-a3e1-0e0742774310 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:36.175953 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8cc83ded-7b52-4d0c-a3e1-0e0742774310 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:36.176469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8cc83ded-7b52-4d0c-a3e1-0e0742774310 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:36.177677 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8cc83ded-7b52-4d0c-a3e1-0e0742774310 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:36.178083 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8cc83ded-7b52-4d0c-a3e1-0e0742774310 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:36.253392 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8cc83ded-7b52-4d0c-a3e1-0e0742774310 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28611 microversion: 2.1 time: 0.088702 Dec 13 23:04:36.255528 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 146/294] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:36 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:36.355068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1908999108", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "53d3a17f-2e01-4301-affb-58f20cc0584b"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:36.421601 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] validate_networks() for [('53d3a17f-2e01-4301-affb-58f20cc0584b', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:04:36.478436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-76cb82fa-79e7-4e36-814d-943f7f637a72 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:36.479734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-76cb82fa-79e7-4e36-814d-943f7f637a72 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:36.487766 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76cb82fa-79e7-4e36-814d-943f7f637a72 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:36.489103 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76cb82fa-79e7-4e36-814d-943f7f637a72 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:36.490144 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76cb82fa-79e7-4e36-814d-943f7f637a72 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:36.491061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76cb82fa-79e7-4e36-814d-943f7f637a72 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:36.584539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-76cb82fa-79e7-4e36-814d-943f7f637a72 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28641 microversion: 2.20 time: 0.110401 Dec 13 23:04:36.586740 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 147/295] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:36 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28641 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:04:36.839804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:04:36.840220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:04:36.840685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:04:36.841379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:04:36.841781 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:04:36.854307 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:36.855048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:36.855857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:36.856280 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:36.883501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Getting quotas for project a736ec919343435d98e16479a93c4119. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:04:36.891695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Getting quotas for user e442d32351e74eda9e6eb7f01c15f886 and project a736ec919343435d98e16479a93c4119. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:04:36.915950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:04:36.918845 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:04:36.969645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8aae080a-550a-480e-b63c-c0a6d16917b5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620076 Dec 13 23:04:36.970473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 149/296] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:04:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:04:36.982508 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c80d386e-c1ae-47d1-aadc-f2bdd2c0dc12 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:36.983709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c80d386e-c1ae-47d1-aadc-f2bdd2c0dc12 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:36.985023 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:36.989484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:36.999411 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:36.999865 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:37.000657 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:37.001099 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:37.051355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c80d386e-c1ae-47d1-aadc-f2bdd2c0dc12 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:37.064282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c80d386e-c1ae-47d1-aadc-f2bdd2c0dc12 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1219 microversion: 2.1 time: 0.085912 Dec 13 23:04:37.065482 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 150/297] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:36 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:37.193842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:37.203892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2b9caae7-7c0a-4265-a150-72412de6b1e2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1322 microversion: 2.1 time: 0.225407 Dec 13 23:04:37.204455 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 148/298] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:36 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:37.265411 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a223485d-e1f3-4618-af0f-551c97e4558e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:37.266436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a223485d-e1f3-4618-af0f-551c97e4558e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:37.279344 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a223485d-e1f3-4618-af0f-551c97e4558e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:37.281182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a223485d-e1f3-4618-af0f-551c97e4558e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:37.283882 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a223485d-e1f3-4618-af0f-551c97e4558e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:37.287129 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a223485d-e1f3-4618-af0f-551c97e4558e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:37.409160 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a223485d-e1f3-4618-af0f-551c97e4558e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28611 microversion: 2.1 time: 0.146565 Dec 13 23:04:37.414251 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 151/299] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:37 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28611 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:37.598393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-952db440-a076-430d-89c1-ecf0f4dd181e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:37.599323 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-952db440-a076-430d-89c1-ecf0f4dd181e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:37.605644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-952db440-a076-430d-89c1-ecf0f4dd181e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:37.606347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-952db440-a076-430d-89c1-ecf0f4dd181e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:37.607378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-952db440-a076-430d-89c1-ecf0f4dd181e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:37.608107 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-952db440-a076-430d-89c1-ecf0f4dd181e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:37.614368 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-54731705-5e77-477d-ad68-cd76d8e7759e req-50a08bc3-50e0-423b-867c-a7f978e9a345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad7412a-5ada-4048-a735-b557f4868be5", "name": "network-vif-plugged", "status": "completed", "tag": "64ee4b02-4e4c-45cd-af6e-2d1e7a92f1e9"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:37.616426 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:37.616426 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:04:37.625597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-54731705-5e77-477d-ad68-cd76d8e7759e req-50a08bc3-50e0-423b-867c-a7f978e9a345 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:37.626192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-54731705-5e77-477d-ad68-cd76d8e7759e req-50a08bc3-50e0-423b-867c-a7f978e9a345 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:37.638627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-54731705-5e77-477d-ad68-cd76d8e7759e req-50a08bc3-50e0-423b-867c-a7f978e9a345 service nova] Creating event network-vif-plugged:64ee4b02-4e4c-45cd-af6e-2d1e7a92f1e9 for instance 8ad7412a-5ada-4048-a735-b557f4868be5 on hv-cinder-79628 Dec 13 23:04:37.644138 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-54731705-5e77-477d-ad68-cd76d8e7759e req-50a08bc3-50e0-423b-867c-a7f978e9a345 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034304 Dec 13 23:04:37.648069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 152/300] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:04:37.723044 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-952db440-a076-430d-89c1-ecf0f4dd181e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28641 microversion: 2.20 time: 0.128165 Dec 13 23:04:37.727242 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 149/301] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:37 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28641 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:38.088199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:38.089205 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:38.099924 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.100584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.101593 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.102207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.187150 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:38.195121 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-35c90baf-97cb-47f6-92c0-b91c57a65ac8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1271 microversion: 2.1 time: 0.114963 Dec 13 23:04:38.195991 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 153/302] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:38 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:38.220315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:38.221716 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:38.228923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.229537 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.230559 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.231203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.407709 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:38.418444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-46df6e28-48f9-4b35-a2d7-a312b8a794fa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1322 microversion: 2.1 time: 0.200415 Dec 13 23:04:38.420143 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 150/303] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:38 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:38.423587 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8cdf5dde-31c2-4d7a-89a3-b53f99c5e3ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:38.425513 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8cdf5dde-31c2-4d7a-89a3-b53f99c5e3ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:38.434173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdf5dde-31c2-4d7a-89a3-b53f99c5e3ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.434913 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdf5dde-31c2-4d7a-89a3-b53f99c5e3ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.436000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdf5dde-31c2-4d7a-89a3-b53f99c5e3ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.436620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdf5dde-31c2-4d7a-89a3-b53f99c5e3ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.559384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8cdf5dde-31c2-4d7a-89a3-b53f99c5e3ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28611 microversion: 2.1 time: 0.141206 Dec 13 23:04:38.561590 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 154/304] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:38 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28611 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:38.735687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a34b5f37-aa21-4b0c-9008-1ce31e88cd5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:38.737175 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a34b5f37-aa21-4b0c-9008-1ce31e88cd5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:38.745154 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a34b5f37-aa21-4b0c-9008-1ce31e88cd5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.745936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a34b5f37-aa21-4b0c-9008-1ce31e88cd5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.747205 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a34b5f37-aa21-4b0c-9008-1ce31e88cd5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:38.747742 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a34b5f37-aa21-4b0c-9008-1ce31e88cd5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:38.820972 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a34b5f37-aa21-4b0c-9008-1ce31e88cd5f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28641 microversion: 2.20 time: 0.089451 Dec 13 23:04:38.826051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 151/305] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:38 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28641 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:39.213179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:39.213939 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:39.220649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.221093 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.222009 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.222415 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.437304 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:39.438621 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:39.450922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.452001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.455281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:39.455794 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.456088 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.467140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6e2ea210-ce8b-4721-86ea-598c60d0bde6 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.258373 Dec 13 23:04:39.468073 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 155/306] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:39 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:39.572855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4843d564-f003-45e6-ae25-b95ce941bfad tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:39.573808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4843d564-f003-45e6-ae25-b95ce941bfad tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:39.583484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4843d564-f003-45e6-ae25-b95ce941bfad tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.583939 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4843d564-f003-45e6-ae25-b95ce941bfad tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.585189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4843d564-f003-45e6-ae25-b95ce941bfad tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.585665 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4843d564-f003-45e6-ae25-b95ce941bfad tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.679069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4843d564-f003-45e6-ae25-b95ce941bfad tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 28611 microversion: 2.1 time: 0.110525 Dec 13 23:04:39.679981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 156/307] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:39 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 28611 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:39.726208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:39.734775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1ba074ea-404a-499e-9281-2939b332c5b2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1322 microversion: 2.1 time: 0.302173 Dec 13 23:04:39.735596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 152/308] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:39 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:39.834145 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bc03f37c-084f-428b-8657-08c9743f90e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:39.834958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bc03f37c-084f-428b-8657-08c9743f90e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:39.842239 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc03f37c-084f-428b-8657-08c9743f90e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.842761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc03f37c-084f-428b-8657-08c9743f90e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.843644 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc03f37c-084f-428b-8657-08c9743f90e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:39.844103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc03f37c-084f-428b-8657-08c9743f90e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:39.961604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bc03f37c-084f-428b-8657-08c9743f90e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 28869 microversion: 2.20 time: 0.132488 Dec 13 23:04:39.965756 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 157/309] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:39 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 28869 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:40.118606 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-fab374aa-5b62-4657-9651-45294125b03f req-336591c2-bb34-4133-91e2-cc02aadec966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e52bcc7-ca2c-4d3d-b4e9-8343e896825a", "tag": "1489cd5c-d9ef-4e3b-95b7-b3103b1fe937"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:40.120194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:40.120194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:40.132856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-fab374aa-5b62-4657-9651-45294125b03f req-336591c2-bb34-4133-91e2-cc02aadec966 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.133454 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-fab374aa-5b62-4657-9651-45294125b03f req-336591c2-bb34-4133-91e2-cc02aadec966 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.156381 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-fab374aa-5b62-4657-9651-45294125b03f req-336591c2-bb34-4133-91e2-cc02aadec966 service nova] Creating event network-changed:1489cd5c-d9ef-4e3b-95b7-b3103b1fe937 for instance 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a on hv-cinder-79628 Dec 13 23:04:40.163976 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-fab374aa-5b62-4657-9651-45294125b03f req-336591c2-bb34-4133-91e2-cc02aadec966 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048247 Dec 13 23:04:40.165053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 153/310] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:04:40.485944 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:40.486626 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:40.494343 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.494800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.495855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.496282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.692815 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b0b3e9f7-95f0-4fac-85cf-df57a22a8601 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:40.694170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b0b3e9f7-95f0-4fac-85cf-df57a22a8601 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:40.702642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0b3e9f7-95f0-4fac-85cf-df57a22a8601 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.703228 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0b3e9f7-95f0-4fac-85cf-df57a22a8601 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.704310 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0b3e9f7-95f0-4fac-85cf-df57a22a8601 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.704884 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0b3e9f7-95f0-4fac-85cf-df57a22a8601 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.816787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b0b3e9f7-95f0-4fac-85cf-df57a22a8601 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 29244 microversion: 2.1 time: 0.128482 Dec 13 23:04:40.822051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 154/311] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:40 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 29244 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:04:40.829584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:40.831152 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:40.840040 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.840725 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.841683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.842284 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.907783 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:40.916809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db22e5b6-03fa-4dcd-be50-26c98f7abded tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.435006 Dec 13 23:04:40.917412 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 158/312] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:40 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:40.973224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4f96ef90-0a7b-43e1-aa6d-5afc4b8252c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:40.974283 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4f96ef90-0a7b-43e1-aa6d-5afc4b8252c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:40.984778 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f96ef90-0a7b-43e1-aa6d-5afc4b8252c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.985998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f96ef90-0a7b-43e1-aa6d-5afc4b8252c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:40.986949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f96ef90-0a7b-43e1-aa6d-5afc4b8252c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:40.987589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4f96ef90-0a7b-43e1-aa6d-5afc4b8252c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.060762 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:41.069827 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-35a5edb9-dafc-4774-8b69-6fc05ebc0bf7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1516 microversion: 2.1 time: 0.246030 Dec 13 23:04:41.070384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 155/313] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:40 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:41.088642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:41.089878 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:41.096492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.097276 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.098401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.099391 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.104909 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4f96ef90-0a7b-43e1-aa6d-5afc4b8252c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 30890 microversion: 2.20 time: 0.135301 Dec 13 23:04:41.107421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 159/314] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:40 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 30890 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:41.127562 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lazy-loading 'flavor' on Instance uuid 8ad7412a-5ada-4048-a735-b557f4868be5 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:04:41.266201 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-825d50a4-6894-42ce-9683-af08936717e6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5/action" status: 200 len: 32 microversion: 2.1 time: 0.181691 Dec 13 23:04:41.266902 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 156/315] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:41 2021] POST /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:04:41.277210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:41.278406 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:41.286646 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.287685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.288549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.289008 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.502178 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:41.510745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a38fd35-e615-4328-9466-ee0c1ba8bc2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.238392 Dec 13 23:04:41.511699 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 160/316] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:41 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:41.734007 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f602ef42-2923-4311-a21f-8329c6f93135"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:41.735147 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:41.742222 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.742673 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.743451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.743883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.822311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] HTTP exception thrown: Invalid volume: volume f602ef42-2923-4311-a21f-8329c6f93135 is already attached to instances: 66106e4e-2ac2-4866-a07d-20f05ada9bf8 Dec 13 23:04:41.823377 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Returning 400 to user: Invalid volume: volume f602ef42-2923-4311-a21f-8329c6f93135 is already attached to instances: 66106e4e-2ac2-4866-a07d-20f05ada9bf8 {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:04:41.824295 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-98768b0f-b2d7-472f-b51c-758d3ac477f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095070 Dec 13 23:04:41.825173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 157/317] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:04:41 2021] POST /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:04:41.827908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b8221a68-187f-4008-9797-a60f6f78dede tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:41.829069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b8221a68-187f-4008-9797-a60f6f78dede tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:41.836823 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8221a68-187f-4008-9797-a60f6f78dede tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.837262 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8221a68-187f-4008-9797-a60f6f78dede tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.838045 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8221a68-187f-4008-9797-a60f6f78dede tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.838625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8221a68-187f-4008-9797-a60f6f78dede tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.887960 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:41.888455 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:41.894582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.895238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.896199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.896632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.954022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b8221a68-187f-4008-9797-a60f6f78dede tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 30338 microversion: 2.1 time: 0.129497 Dec 13 23:04:41.955496 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 161/318] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:41 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 30338 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:04:41.959692 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:41.960505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:41.968602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.968986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.969804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:41.970230 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:41.982306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lazy-loading 'services' on Instance uuid 66106e4e-2ac2-4866-a07d-20f05ada9bf8 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:04:42.060819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8d7f9c19-9eb2-49bf-84c6-ba1245d2175c tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments/f602ef42-2923-4311-a21f-8329c6f93135" status: 202 len: 0 microversion: 2.1 time: 0.176469 Dec 13 23:04:42.064738 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 158/319] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:04:41 2021] DELETE /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments/f602ef42-2923-4311-a21f-8329c6f93135 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:42.074907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bcc3e77e-f147-464a-8f93-06814f317133 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:42.076110 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bcc3e77e-f147-464a-8f93-06814f317133 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:42.083875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcc3e77e-f147-464a-8f93-06814f317133 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.084468 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcc3e77e-f147-464a-8f93-06814f317133 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.085469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcc3e77e-f147-464a-8f93-06814f317133 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.086025 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcc3e77e-f147-464a-8f93-06814f317133 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.120943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bcc3e77e-f147-464a-8f93-06814f317133 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050470 Dec 13 23:04:42.121775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 159/320] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:04:42 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:42.126162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:42.136748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c853b52e-bb05-4c38-974e-5bbb1bc37334 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:42.137695 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c853b52e-bb05-4c38-974e-5bbb1bc37334 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:42.137926 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2257b80e-70c5-4f3c-98fc-4ba9bb29ff9d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.177981 Dec 13 23:04:42.138546 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 162/321] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:41 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:42.143393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c853b52e-bb05-4c38-974e-5bbb1bc37334 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.143985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c853b52e-bb05-4c38-974e-5bbb1bc37334 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.145041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c853b52e-bb05-4c38-974e-5bbb1bc37334 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.145671 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c853b52e-bb05-4c38-974e-5bbb1bc37334 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.249824 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c853b52e-bb05-4c38-974e-5bbb1bc37334 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 31944 microversion: 2.20 time: 0.126523 Dec 13 23:04:42.251413 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 160/322] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:42 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 31944 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:42.328966 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1163691319", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:42.382746 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] validate_networks() for None {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:04:42.528963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:42.529638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:42.537737 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.538187 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.538970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.539402 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.703252 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:04:42.703880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:04:42.704203 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:04:42.704657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:04:42.705069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:04:42.715869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.716779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.717227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.717718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.731867 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:42.735534 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Getting quotas for project 26b04bc9649f42f397afedbb1c478345. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:04:42.739927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Getting quotas for user 7ab16702411242ffa61579e585a1bf8f and project 26b04bc9649f42f397afedbb1c478345. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:04:42.740448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-734f8461-854b-47e1-908b-09a951a1a635 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.215846 Dec 13 23:04:42.741027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 161/323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:42 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:42.753445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:04:42.755937 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:04:42.799931 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-29958bd1-9f2f-4cc1-b827-91509862fde3 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474452 Dec 13 23:04:42.800558 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 163/324] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:04:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:04:42.811216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cc512716-6e73-4d70-9be4-30dd9995cb38 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:42.811887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cc512716-6e73-4d70-9be4-30dd9995cb38 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:42.870681 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cc512716-6e73-4d70-9be4-30dd9995cb38 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:42.878363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cc512716-6e73-4d70-9be4-30dd9995cb38 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1215 microversion: 2.1 time: 0.070892 Dec 13 23:04:42.878975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:42 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:42.967028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-97c188c9-e2f7-497f-ab5a-45c205710633 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:42.968057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-97c188c9-e2f7-497f-ab5a-45c205710633 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:42.975904 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97c188c9-e2f7-497f-ab5a-45c205710633 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.976739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97c188c9-e2f7-497f-ab5a-45c205710633 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:42.977648 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97c188c9-e2f7-497f-ab5a-45c205710633 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:42.978085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-97c188c9-e2f7-497f-ab5a-45c205710633 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.071212 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-97c188c9-e2f7-497f-ab5a-45c205710633 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 31486 microversion: 2.1 time: 0.107978 Dec 13 23:04:43.072224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 164/326] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:42 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 31486 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:43.133633 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1f420cdb-52e8-4952-b10a-b5fd038714ea tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:43.134722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1f420cdb-52e8-4952-b10a-b5fd038714ea tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:43.141921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f420cdb-52e8-4952-b10a-b5fd038714ea tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.142370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f420cdb-52e8-4952-b10a-b5fd038714ea tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.143189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f420cdb-52e8-4952-b10a-b5fd038714ea tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.143628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f420cdb-52e8-4952-b10a-b5fd038714ea tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.156393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:43.157354 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:43.165617 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.166441 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.167378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.168010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.178787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1f420cdb-52e8-4952-b10a-b5fd038714ea tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049560 Dec 13 23:04:43.184558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 163/327] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:04:43 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:04:43.269969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8002fcc0-7b55-4507-9561-6ba4836fd0e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:43.274218 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8002fcc0-7b55-4507-9561-6ba4836fd0e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:43.287401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8002fcc0-7b55-4507-9561-6ba4836fd0e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.288517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8002fcc0-7b55-4507-9561-6ba4836fd0e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.290019 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8002fcc0-7b55-4507-9561-6ba4836fd0e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.291277 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8002fcc0-7b55-4507-9561-6ba4836fd0e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.377578 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:43.393554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-951c6c7f-7132-4d7b-8eb8-ebd84121f726 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.241399 Dec 13 23:04:43.394271 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 165/328] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:43 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:43.399602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1831154647", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "e25a0760-1b13-4e1d-bcac-3c85e52e485e"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:43.417904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8002fcc0-7b55-4507-9561-6ba4836fd0e7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 32874 microversion: 2.20 time: 0.156825 Dec 13 23:04:43.418565 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 164/329] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:43 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 32874 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:43.469194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] validate_networks() for [('e25a0760-1b13-4e1d-bcac-3c85e52e485e', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:04:43.762548 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:43.764026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:43.773073 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.773501 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.780847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:43.781569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:43.990212 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:04:43.991008 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:04:43.991221 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:04:43.991950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:04:43.992688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:04:44.005283 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.005999 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.006897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.007325 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.021695 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:44.030179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c85024f3-d969-469a-994e-976e89b3298e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.275755 Dec 13 23:04:44.031714 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 165/330] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:43 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:44.040772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:04:44.043950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:44.044923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:44.046494 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Getting quotas for user 916e287d50864a638d3b1efe692e78e4 and project 64e3cc2f6e6e4265a268b5f871a7d92c. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:04:44.055528 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.056308 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.057133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.057623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.059819 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:04:44.062403 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:04:44.121439 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3117f73f-53f4-4d6a-bdf0-dab693cec8f7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725532 Dec 13 23:04:44.123573 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 166/331] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:04:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:04:44.128765 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-20445066-3bc3-4acf-8934-8821f239ccfa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:44.130813 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-20445066-3bc3-4acf-8934-8821f239ccfa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:44.137997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20445066-3bc3-4acf-8934-8821f239ccfa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.138695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20445066-3bc3-4acf-8934-8821f239ccfa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.139944 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20445066-3bc3-4acf-8934-8821f239ccfa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.140571 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20445066-3bc3-4acf-8934-8821f239ccfa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.166112 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:44.177934 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d9495260-75da-4f9b-aa15-187d18b218ee tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1275 microversion: 2.1 time: 0.145814 Dec 13 23:04:44.196529 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 166/332] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:44 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:44.203830 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0928c1cf-509e-431e-9628-4fb716403f64 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:44.206341 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0928c1cf-509e-431e-9628-4fb716403f64 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:44.268422 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0928c1cf-509e-431e-9628-4fb716403f64 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:44.280247 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0928c1cf-509e-431e-9628-4fb716403f64 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1218 microversion: 2.1 time: 0.078511 Dec 13 23:04:44.284226 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 167/333] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:44 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:44.413357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:44.414210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:44.420617 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.421073 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.421917 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.422370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.560683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:44.568431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c1affe51-fd10-4df1-8c83-aef94d615671 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.158691 Dec 13 23:04:44.569069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 168/334] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:44 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:44.573787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a018463f-f7f8-46e5-98c6-2eaa097218c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:44.574748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a018463f-f7f8-46e5-98c6-2eaa097218c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:44.580325 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a018463f-f7f8-46e5-98c6-2eaa097218c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.580807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a018463f-f7f8-46e5-98c6-2eaa097218c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:44.581600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a018463f-f7f8-46e5-98c6-2eaa097218c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:44.582055 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a018463f-f7f8-46e5-98c6-2eaa097218c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.126758 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-20445066-3bc3-4acf-8934-8821f239ccfa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 32636 microversion: 2.1 time: 2.001104 Dec 13 23:04:46.127623 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 167/335] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:44 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 32636 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:46.134384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:46.135085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:46.142552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.143007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.143844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.144291 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.299088 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:46.308181 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c5899c38-178d-4f48-974f-2819107ac2be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.179076 Dec 13 23:04:46.308760 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 168/336] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:46 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:46.313357 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:46.313966 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:46.319818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.320263 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.321041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.321502 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.380420 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:46.387891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1354fe2c-f90d-4f7b-ae32-d0ef3cb3048f tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1273 microversion: 2.1 time: 0.078151 Dec 13 23:04:46.388457 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 169/337] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:46 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1273 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:46.392953 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:46.393585 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:46.400195 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.400653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.401464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.401882 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.472873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:46.482800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-40ad14fe-bbb2-47fe-af69-397ca42b2769 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1222 microversion: 2.1 time: 0.093124 Dec 13 23:04:46.483504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 170/338] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:46 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:46.487728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:46.488328 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:46.494417 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.494866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.495663 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:46.496095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:46.635709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:46.643443 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dd4c9b55-dbe8-45c7-a153-d5546980bacc tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.158962 Dec 13 23:04:46.644019 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 171/339] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:46 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:47.183159 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d31e3268-3de5-4ca6-9ace-01c845004fcb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:47.184219 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d31e3268-3de5-4ca6-9ace-01c845004fcb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:47.192934 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d31e3268-3de5-4ca6-9ace-01c845004fcb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.193657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d31e3268-3de5-4ca6-9ace-01c845004fcb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.194683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d31e3268-3de5-4ca6-9ace-01c845004fcb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.195254 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d31e3268-3de5-4ca6-9ace-01c845004fcb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.249241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a018463f-f7f8-46e5-98c6-2eaa097218c0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 35096 microversion: 2.20 time: 2.678925 Dec 13 23:04:47.249933 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 169/340] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:44 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 35096 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:47.325204 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:47.326039 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:47.332616 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.333054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.334035 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.334035 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.354394 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d31e3268-3de5-4ca6-9ace-01c845004fcb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 33872 microversion: 2.1 time: 0.177150 Dec 13 23:04:47.355046 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 172/341] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:47 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 33872 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:47.407337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:47.412736 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:47.422227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.422227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.423010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.423443 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.488444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:47.497947 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cdfa3e24-87d9-4d05-a805-4a96cbdd5403 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.176519 Dec 13 23:04:47.508632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 170/342] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:47 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:47.508632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:47.508632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:47.511565 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.512060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.513021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.513814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.520461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:47.528787 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6cc9464a-ae61-4e2b-83fb-a2d74aa52e42 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1273 microversion: 2.1 time: 0.127601 Dec 13 23:04:47.529832 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 173/343] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:47 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:47.578901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:47.587179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8e852bf6-45e6-4cc0-a1a4-436de697fe67 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1270 microversion: 2.1 time: 0.087063 Dec 13 23:04:47.587731 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 171/344] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:47 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:47.660087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:47.660825 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:47.667565 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.668011 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.668803 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:47.669251 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:47.803968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:47.811273 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-30d405d1-a9a2-4d4a-a258-8f708bf749cb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.154980 Dec 13 23:04:47.811844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 174/345] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:47 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:48.261902 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-82f85e4b-9ccf-48a6-8275-5f79cd094a08 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:48.265217 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-82f85e4b-9ccf-48a6-8275-5f79cd094a08 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:48.271326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82f85e4b-9ccf-48a6-8275-5f79cd094a08 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.271782 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82f85e4b-9ccf-48a6-8275-5f79cd094a08 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.272583 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82f85e4b-9ccf-48a6-8275-5f79cd094a08 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.273018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82f85e4b-9ccf-48a6-8275-5f79cd094a08 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.366402 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-13f915b6-96da-42c3-b692-97d30c1793ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:48.367369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-13f915b6-96da-42c3-b692-97d30c1793ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:48.373790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13f915b6-96da-42c3-b692-97d30c1793ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.374688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13f915b6-96da-42c3-b692-97d30c1793ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.375746 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13f915b6-96da-42c3-b692-97d30c1793ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.376338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13f915b6-96da-42c3-b692-97d30c1793ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.377067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-82f85e4b-9ccf-48a6-8275-5f79cd094a08 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 35698 microversion: 2.20 time: 0.118468 Dec 13 23:04:48.378510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 172/346] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:48 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 35698 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:48.473801 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-13f915b6-96da-42c3-b692-97d30c1793ea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 34575 microversion: 2.1 time: 0.110460 Dec 13 23:04:48.474732 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 175/347] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:48 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 34575 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:04:48.518119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:48.519206 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:48.531145 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.531827 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.533203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.534271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.549626 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:48.550504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:48.576855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.578924 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.582340 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.582901 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.932127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:48.950044 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-19dcc487-4813-45f0-abd7-6a27a7ce0441 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.437832 Dec 13 23:04:48.951007 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 173/348] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:48 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:48.959441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:48.959441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:48.968294 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.968294 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.969054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:48.978258 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:48.983986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:48.999332 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a8d5059a-ad4a-4ed2-9567-01feaa7fefc4 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1315 microversion: 2.1 time: 0.455435 Dec 13 23:04:49.001399 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 176/349] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:48 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:49.008423 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-16899181-de99-4c5d-941a-886aad3b555c req-6ab0b59d-05cb-4648-8a23-b51545f427cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f6b1de-5be0-4140-8450-4837220d3ddc", "tag": "77c0d7f8-a569-4cac-82a4-f32e4db4ad60"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:49.011402 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:49.011402 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:04:49.019288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-16899181-de99-4c5d-941a-886aad3b555c req-6ab0b59d-05cb-4648-8a23-b51545f427cb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.019943 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-16899181-de99-4c5d-941a-886aad3b555c req-6ab0b59d-05cb-4648-8a23-b51545f427cb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.035329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-16899181-de99-4c5d-941a-886aad3b555c req-6ab0b59d-05cb-4648-8a23-b51545f427cb service nova] Creating event network-changed:77c0d7f8-a569-4cac-82a4-f32e4db4ad60 for instance 75f6b1de-5be0-4140-8450-4837220d3ddc on hv-cinder-79628 Dec 13 23:04:49.040658 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-16899181-de99-4c5d-941a-886aad3b555c req-6ab0b59d-05cb-4648-8a23-b51545f427cb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039062 Dec 13 23:04:49.041806 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 177/350] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:49.046971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:49.047797 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:49.054891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.055457 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.056447 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.056962 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.317198 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:49.326174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-27cef78e-2def-4f8d-8e60-4bd95b1ee6b4 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.373977 Dec 13 23:04:49.336350 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 174/351] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:48 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:49.362067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:49.381410 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-699b4608-5a85-40e4-ab5a-4a544eb4d013 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.338164 Dec 13 23:04:49.383179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 178/352] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:49 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:49.396368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8ed4fd10-06a5-422a-93e1-ba7db52f0445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:49.397841 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8ed4fd10-06a5-422a-93e1-ba7db52f0445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:49.406849 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ed4fd10-06a5-422a-93e1-ba7db52f0445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.407600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ed4fd10-06a5-422a-93e1-ba7db52f0445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.408660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ed4fd10-06a5-422a-93e1-ba7db52f0445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.409095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ed4fd10-06a5-422a-93e1-ba7db52f0445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.488142 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fb1ae823-e8ca-4f50-8622-015446ccef78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:49.490107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fb1ae823-e8ca-4f50-8622-015446ccef78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:49.497227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb1ae823-e8ca-4f50-8622-015446ccef78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.497956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb1ae823-e8ca-4f50-8622-015446ccef78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.499121 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb1ae823-e8ca-4f50-8622-015446ccef78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.500196 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb1ae823-e8ca-4f50-8622-015446ccef78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.541926 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8ed4fd10-06a5-422a-93e1-ba7db52f0445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 36619 microversion: 2.20 time: 0.150193 Dec 13 23:04:49.547948 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 175/353] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:49 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 36619 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:04:49.554347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-d10638e6-b378-4135-aa24-0bf541a7a62c req-a319c662-f05b-4c16-acac-0ac91b8c45fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e52bcc7-ca2c-4d3d-b4e9-8343e896825a", "name": "network-vif-plugged", "status": "completed", "tag": "1489cd5c-d9ef-4e3b-95b7-b3103b1fe937"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:49.555868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:49.555868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:49.563879 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-d10638e6-b378-4135-aa24-0bf541a7a62c req-a319c662-f05b-4c16-acac-0ac91b8c45fb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.564221 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-d10638e6-b378-4135-aa24-0bf541a7a62c req-a319c662-f05b-4c16-acac-0ac91b8c45fb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.582443 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-d10638e6-b378-4135-aa24-0bf541a7a62c req-a319c662-f05b-4c16-acac-0ac91b8c45fb service nova] Creating event network-vif-plugged:1489cd5c-d9ef-4e3b-95b7-b3103b1fe937 for instance 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a on hv-cinder-79628 Dec 13 23:04:49.587984 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-d10638e6-b378-4135-aa24-0bf541a7a62c req-a319c662-f05b-4c16-acac-0ac91b8c45fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038405 Dec 13 23:04:49.589164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 176/354] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:49.629518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fb1ae823-e8ca-4f50-8622-015446ccef78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 35337 microversion: 2.1 time: 0.144858 Dec 13 23:04:49.631502 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 179/355] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:49 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 35337 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:04:49.932463 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-24d48e37-1c4c-4386-9790-095123fd5727 req-fca373b5-8507-4e0e-a69f-f4f1e97ce4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a", "tag": "02c6fedf-f723-4463-8f11-189373d87d07"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:49.935683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:49.935683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:49.961126 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-24d48e37-1c4c-4386-9790-095123fd5727 req-fca373b5-8507-4e0e-a69f-f4f1e97ce4aa service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.961858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-24d48e37-1c4c-4386-9790-095123fd5727 req-fca373b5-8507-4e0e-a69f-f4f1e97ce4aa service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.968697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:49.969462 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:49.980771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.981224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.984817 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:49.987440 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:49.998046 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-24d48e37-1c4c-4386-9790-095123fd5727 req-fca373b5-8507-4e0e-a69f-f4f1e97ce4aa service nova] Creating event network-changed:02c6fedf-f723-4463-8f11-189373d87d07 for instance 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a on hv-cinder-79628 Dec 13 23:04:50.003251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-24d48e37-1c4c-4386-9790-095123fd5727 req-fca373b5-8507-4e0e-a69f-f4f1e97ce4aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076859 Dec 13 23:04:50.009442 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 177/356] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:50.019666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:50.020372 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:50.027155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.027597 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.028388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.028870 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.409621 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:50.413187 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:50.417536 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d61345a9-f448-42da-a004-02c833c62fbb tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1315 microversion: 2.1 time: 0.403396 Dec 13 23:04:50.418111 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 178/357] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:50 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:50.422449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:50.423051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:50.429799 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.430251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.430384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-218907e9-dff6-4a7b-a964-ffebb9765f70 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.466242 Dec 13 23:04:50.430903 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 180/358] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:49 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:50.431014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.431505 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.435520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:50.436286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:50.442165 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.442613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.443729 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.444182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.699951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:50.705828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:50.715232 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-558bbb30-8363-408c-89a0-e3db86d48f79 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.296093 Dec 13 23:04:50.715670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ea650cdc-c62f-4ad2-96b2-ec72e450345c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.283613 Dec 13 23:04:50.725320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 179/359] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:50 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:50.725320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a957046c-555e-4b84-a306-cc210a32a555 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:50.725320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a957046c-555e-4b84-a306-cc210a32a555 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:50.725855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 181/360] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:50 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:50.730420 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a4354312-2deb-45ec-ab97-d9a1e0e724ce tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:50.731541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a4354312-2deb-45ec-ab97-d9a1e0e724ce tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:50.733305 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a957046c-555e-4b84-a306-cc210a32a555 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.734234 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a957046c-555e-4b84-a306-cc210a32a555 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.734795 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a957046c-555e-4b84-a306-cc210a32a555 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.735321 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a957046c-555e-4b84-a306-cc210a32a555 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.737327 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4354312-2deb-45ec-ab97-d9a1e0e724ce tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.737788 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4354312-2deb-45ec-ab97-d9a1e0e724ce tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.738726 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4354312-2deb-45ec-ab97-d9a1e0e724ce tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:50.738973 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4354312-2deb-45ec-ab97-d9a1e0e724ce tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:50.847276 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a4354312-2deb-45ec-ab97-d9a1e0e724ce tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 36213 microversion: 2.1 time: 0.120340 Dec 13 23:04:50.847910 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 182/361] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:50 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 36213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:50.881924 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a957046c-555e-4b84-a306-cc210a32a555 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 37399 microversion: 2.20 time: 0.164674 Dec 13 23:04:50.882575 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 180/362] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:50 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 37399 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:51.435447 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:51.436627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:51.443896 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.444653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.445705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.446611 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.447887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:51.449128 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:51.456147 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.456855 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.457844 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.459076 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.710361 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:51.718286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:51.719610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dbb4ea95-899f-48ba-99dc-03c6cef54bba tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1315 microversion: 2.1 time: 0.288128 Dec 13 23:04:51.720288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 183/363] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:51 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:51.730398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-34493612-d17f-4da1-b05b-85fb8e05988c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.285075 Dec 13 23:04:51.730398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 181/364] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:51 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:51.731786 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:51.732360 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:51.734269 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:51.735084 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:51.739404 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.740180 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.740980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.741430 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.743289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.743734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.744705 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.745131 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.938853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:51.946919 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:51.947788 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-76e2e609-8c03-4e9a-b9a4-b0769f77f907 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1319 microversion: 2.1 time: 0.217177 Dec 13 23:04:51.948389 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 182/365] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:51 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:51.952949 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-fb091d2e-8fde-43a4-8c58-b30c893fb3c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:51.954186 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-fb091d2e-8fde-43a4-8c58-b30c893fb3c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:51.960089 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-21aa7d3c-b82c-46ee-ac7c-524de163bf66 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.231709 Dec 13 23:04:51.960718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 184/366] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:51 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:51.960889 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fb091d2e-8fde-43a4-8c58-b30c893fb3c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.961311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fb091d2e-8fde-43a4-8c58-b30c893fb3c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.962443 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fb091d2e-8fde-43a4-8c58-b30c893fb3c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.962872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fb091d2e-8fde-43a4-8c58-b30c893fb3c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.965140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8cc62126-9ba9-4bbc-a017-a61be708f848 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:51.966089 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8cc62126-9ba9-4bbc-a017-a61be708f848 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:51.972367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cc62126-9ba9-4bbc-a017-a61be708f848 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.972811 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cc62126-9ba9-4bbc-a017-a61be708f848 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:51.973606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cc62126-9ba9-4bbc-a017-a61be708f848 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:51.974028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cc62126-9ba9-4bbc-a017-a61be708f848 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.070539 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8cc62126-9ba9-4bbc-a017-a61be708f848 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 38000 microversion: 2.20 time: 0.108595 Dec 13 23:04:52.071425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 185/367] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:51 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 38000 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:52.090433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-fb091d2e-8fde-43a4-8c58-b30c893fb3c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 36846 microversion: 2.1 time: 0.140777 Dec 13 23:04:52.095012 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 183/368] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:51 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 36846 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:52.739102 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:52.739900 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:52.745598 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:52.746325 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:52.747367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.747808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.748580 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.749261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.753314 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.753796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.754562 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.755015 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.954535 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:52.962510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:52.965103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-78ca6bb2-46e7-4add-a415-574c4208f1ad tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1315 microversion: 2.1 time: 0.228548 Dec 13 23:04:52.965103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 186/369] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:52 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:52.971147 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:52.971890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:52.978739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.979193 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.979390 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ac3ecb7b-7b51-4157-bc48-0b67a4fcea2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.237882 Dec 13 23:04:52.979982 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 184/370] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:52 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:52.980151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.980395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.984165 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:52.984949 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:52.991203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.991678 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:52.992456 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:52.992879 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.187897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:53.191190 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:53.195588 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4a52e15d-674d-466b-84e9-90f6564c9675 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1509 microversion: 2.1 time: 0.228343 Dec 13 23:04:53.196163 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 187/371] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:52 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:53.198932 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e260bcc4-429b-48a7-a90d-0e4d24926e22 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.218011 Dec 13 23:04:53.199486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 185/372] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:52 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:53.201105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5ef2b711-b565-4e9c-894c-3c18facd7fe7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:53.202228 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5ef2b711-b565-4e9c-894c-3c18facd7fe7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:53.203818 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f774e58d-772a-494d-b317-8eaa9c394740 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:53.204654 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f774e58d-772a-494d-b317-8eaa9c394740 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:53.209829 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ef2b711-b565-4e9c-894c-3c18facd7fe7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:53.209829 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ef2b711-b565-4e9c-894c-3c18facd7fe7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.210472 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f774e58d-772a-494d-b317-8eaa9c394740 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:53.210798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ef2b711-b565-4e9c-894c-3c18facd7fe7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:53.210889 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f774e58d-772a-494d-b317-8eaa9c394740 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.210972 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5ef2b711-b565-4e9c-894c-3c18facd7fe7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.211700 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f774e58d-772a-494d-b317-8eaa9c394740 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:53.212093 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f774e58d-772a-494d-b317-8eaa9c394740 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.316582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f774e58d-772a-494d-b317-8eaa9c394740 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 37681 microversion: 2.1 time: 0.115871 Dec 13 23:04:53.317494 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 186/373] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:53 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 37681 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:53.344741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5ef2b711-b565-4e9c-894c-3c18facd7fe7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 38160 microversion: 2.20 time: 0.147186 Dec 13 23:04:53.345686 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 188/374] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:53 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 38160 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:53.651568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-678fa698-0206-456e-86a3-32522b0c0828 req-3e560639-49d6-4ac6-bd3a-384d1cddcdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f6b1de-5be0-4140-8450-4837220d3ddc", "name": "network-vif-plugged", "status": "completed", "tag": "77c0d7f8-a569-4cac-82a4-f32e4db4ad60"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:53.653182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:53.653182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:53.664125 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-678fa698-0206-456e-86a3-32522b0c0828 req-3e560639-49d6-4ac6-bd3a-384d1cddcdf9 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:53.664609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-678fa698-0206-456e-86a3-32522b0c0828 req-3e560639-49d6-4ac6-bd3a-384d1cddcdf9 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.676560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-678fa698-0206-456e-86a3-32522b0c0828 req-3e560639-49d6-4ac6-bd3a-384d1cddcdf9 service nova] Creating event network-vif-plugged:77c0d7f8-a569-4cac-82a4-f32e4db4ad60 for instance 75f6b1de-5be0-4140-8450-4837220d3ddc on hv-cinder-79628 Dec 13 23:04:53.682431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-678fa698-0206-456e-86a3-32522b0c0828 req-3e560639-49d6-4ac6-bd3a-384d1cddcdf9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035456 Dec 13 23:04:53.683041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 187/375] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:04:53.981568 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:53.983454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:53.990876 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:53.991611 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.992424 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:53.992866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:53.997706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:53.998386 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:54.004745 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.005188 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.006341 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.006873 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.197646 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:54.201555 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:54.209567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-02e64c29-a840-4ba8-a60b-3be4f3bbd1a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.216326 Dec 13 23:04:54.211077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 188/376] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:53 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:04:54.215479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:54.216076 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:54.221853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.222296 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.223077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.223997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.229543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c3d19e26-cb8a-4c55-a43a-25ab86fd843c tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1315 microversion: 2.1 time: 0.252086 Dec 13 23:04:54.230148 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 189/377] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:53 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:54.329224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2ab5c645-8a2d-4196-b1ee-3e1b96be0a84 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:54.330424 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2ab5c645-8a2d-4196-b1ee-3e1b96be0a84 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:54.337206 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ab5c645-8a2d-4196-b1ee-3e1b96be0a84 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.337753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ab5c645-8a2d-4196-b1ee-3e1b96be0a84 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.338637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ab5c645-8a2d-4196-b1ee-3e1b96be0a84 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.339143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2ab5c645-8a2d-4196-b1ee-3e1b96be0a84 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.366555 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:54.374607 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e232b9c5-3afb-4728-9f75-e74cfe5a49c8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.162550 Dec 13 23:04:54.375163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 189/378] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:54 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:54.379461 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-36c8e32b-5a7e-45fb-9718-c4ca00e56e84 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:54.380379 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-36c8e32b-5a7e-45fb-9718-c4ca00e56e84 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:54.385845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36c8e32b-5a7e-45fb-9718-c4ca00e56e84 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.386284 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36c8e32b-5a7e-45fb-9718-c4ca00e56e84 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.387058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36c8e32b-5a7e-45fb-9718-c4ca00e56e84 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:54.387479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36c8e32b-5a7e-45fb-9718-c4ca00e56e84 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:54.481344 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2ab5c645-8a2d-4196-b1ee-3e1b96be0a84 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 38103 microversion: 2.1 time: 0.155568 Dec 13 23:04:54.482120 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 190/379] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:54 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 38103 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:54.503369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-36c8e32b-5a7e-45fb-9718-c4ca00e56e84 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 38160 microversion: 2.20 time: 0.126805 Dec 13 23:04:54.503944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 190/380] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:54 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 38160 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:55.227765 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:55.228319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:55.235652 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.236138 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.236874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.237305 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.247418 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:55.248147 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:55.255015 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.255461 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.256508 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.256943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.440505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:55.444664 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:55.449172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9d662d41-40db-439d-86a4-fce7ff936e47 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.225534 Dec 13 23:04:55.449794 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 191/381] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:55 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:55.454519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:55.454692 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3f367ad5-66e9-4879-90b5-76a149153c57 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1315 microversion: 2.1 time: 0.211072 Dec 13 23:04:55.455428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 191/382] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:55 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:55.456549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:55.464620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.465062 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.465866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.466295 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.493979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1a429247-d873-4541-8475-d47a8eb65690 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:55.495005 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1a429247-d873-4541-8475-d47a8eb65690 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:55.502312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a429247-d873-4541-8475-d47a8eb65690 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.502935 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a429247-d873-4541-8475-d47a8eb65690 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.504095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a429247-d873-4541-8475-d47a8eb65690 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.504526 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a429247-d873-4541-8475-d47a8eb65690 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.607608 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1a429247-d873-4541-8475-d47a8eb65690 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 38113 microversion: 2.1 time: 0.117097 Dec 13 23:04:55.611750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 192/383] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:55 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 38113 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:55.613773 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:55.613917 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b09f8ed3-27cf-4afb-891a-a246370fd768 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:55.614899 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b09f8ed3-27cf-4afb-891a-a246370fd768 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:55.621641 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b09f8ed3-27cf-4afb-891a-a246370fd768 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.622327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b09f8ed3-27cf-4afb-891a-a246370fd768 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.623312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b09f8ed3-27cf-4afb-891a-a246370fd768 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.623926 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b09f8ed3-27cf-4afb-891a-a246370fd768 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.627980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e383be4c-d437-414f-8a29-10a807c6bd78 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.176811 Dec 13 23:04:55.628615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 192/384] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:55 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:55.720227 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b09f8ed3-27cf-4afb-891a-a246370fd768 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 200 len: 38302 microversion: 2.20 time: 0.110013 Dec 13 23:04:55.720884 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 193/385] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:55 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 38302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:04:55.730852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-65d83cc1-7f14-4501-896d-aad4472345b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:55.731330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-65d83cc1-7f14-4501-896d-aad4472345b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:55.737196 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65d83cc1-7f14-4501-896d-aad4472345b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.737691 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65d83cc1-7f14-4501-896d-aad4472345b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.738436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65d83cc1-7f14-4501-896d-aad4472345b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:55.738860 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65d83cc1-7f14-4501-896d-aad4472345b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:55.762398 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-65d83cc1-7f14-4501-896d-aad4472345b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/ips" status: 200 len: 151 microversion: 2.20 time: 0.035133 Dec 13 23:04:55.762923 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 193/386] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Dec 13 23:04:55 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:56.466080 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:56.466798 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:56.471792 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:56.472373 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:56.473961 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.474351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.475140 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.475593 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.479971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.480727 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.481695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.482304 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.672139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:56.680151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b5bc18ab-9d99-424a-bede-1c61ee3aa9d2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.218211 Dec 13 23:04:56.680711 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 194/387] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:56 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:56.682518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:56.685018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e84eb69d-497f-46f6-9e1a-a7a26e308031 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:56.685983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e84eb69d-497f-46f6-9e1a-a7a26e308031 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:56.690474 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8aac550e-7961-41e3-b845-5a6067a0bb44 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1464 microversion: 2.1 time: 0.222140 Dec 13 23:04:56.691182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 194/388] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:56 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1464 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:56.696293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e84eb69d-497f-46f6-9e1a-a7a26e308031 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.696293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e84eb69d-497f-46f6-9e1a-a7a26e308031 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.696293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e84eb69d-497f-46f6-9e1a-a7a26e308031 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.696293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e84eb69d-497f-46f6-9e1a-a7a26e308031 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.701517 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:56.702151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:56.717226 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.717627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.718411 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.718837 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.818050 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e84eb69d-497f-46f6-9e1a-a7a26e308031 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 200 len: 38232 microversion: 2.1 time: 0.135956 Dec 13 23:04:56.824625 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 195/389] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:04:56 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 38232 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:04:56.831682 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:56.832285 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:56.839425 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.839874 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.840653 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.841051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.863133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:56.867351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:04:56.871034 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-59a49983-0a01-4784-9418-7f8666ab874a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.173252 Dec 13 23:04:56.871573 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 195/390] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:56 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:56.875776 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b846ddc5-0d97-4d13-8617-f2acf8b06380 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:56.876471 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b846ddc5-0d97-4d13-8617-f2acf8b06380 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:56.883013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b846ddc5-0d97-4d13-8617-f2acf8b06380 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.883451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b846ddc5-0d97-4d13-8617-f2acf8b06380 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.884221 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b846ddc5-0d97-4d13-8617-f2acf8b06380 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.884643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b846ddc5-0d97-4d13-8617-f2acf8b06380 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.907833 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b846ddc5-0d97-4d13-8617-f2acf8b06380 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/ips" status: 200 len: 145 microversion: 2.1 time: 0.035230 Dec 13 23:04:56.908389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 196/391] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Dec 13 23:04:56 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:56.954754 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b53615e1-c8f6-40f4-8c81-e922d2fe0eb9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "DELETE /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 204 len: 0 microversion: 2.1 time: 0.127467 Dec 13 23:04:56.955501 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 196/392] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:04:56 2021] DELETE /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:04:56.963851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:56.964464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:56.972519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.972955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:56.974155 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:56.974806 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:57.113184 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:57.120724 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0dc9062a-1358-44f1-92ef-0b01ad79da34 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1470 microversion: 2.1 time: 0.160980 Dec 13 23:04:57.121373 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 197/393] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:56 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:57.530571 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-dfc68e73-acbe-4d88-bdec-046ae74ad101 req-d2e76675-984d-46d5-bcf1-a90d4df848b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a", "name": "network-vif-plugged", "status": "completed", "tag": "02c6fedf-f723-4463-8f11-189373d87d07"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:57.532074 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:04:57.532074 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:04:57.540640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-dfc68e73-acbe-4d88-bdec-046ae74ad101 req-d2e76675-984d-46d5-bcf1-a90d4df848b2 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:57.541160 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-dfc68e73-acbe-4d88-bdec-046ae74ad101 req-d2e76675-984d-46d5-bcf1-a90d4df848b2 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:57.553620 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-dfc68e73-acbe-4d88-bdec-046ae74ad101 req-d2e76675-984d-46d5-bcf1-a90d4df848b2 service nova] Creating event network-vif-plugged:02c6fedf-f723-4463-8f11-189373d87d07 for instance 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a on hv-cinder-79628 Dec 13 23:04:57.558947 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-dfc68e73-acbe-4d88-bdec-046ae74ad101 req-d2e76675-984d-46d5-bcf1-a90d4df848b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032367 Dec 13 23:04:57.559655 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 197/394] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:04:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:04:57.697315 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:57.697978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:57.704755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:57.705368 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:57.706117 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:57.706561 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:57.888921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:57.889879 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:57.893314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:57.897447 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:57.899600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:57.900493 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:57.900926 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:57.901576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6e9b8eaf-32c3-4cdf-8666-e1582bb06bab tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.207957 Dec 13 23:04:57.902160 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 198/395] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:57 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:58.036631 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:58.044270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-36e0bb37-37d9-4c94-8160-f937aabe87d9 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.159894 Dec 13 23:04:58.044812 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 198/396] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:57 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:58.142583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:58.143545 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:58.151526 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:58.151973 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:58.152744 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:58.153177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:58.305556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:58.313044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-42e0a1a3-e669-4b22-822d-8659323ce376 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1470 microversion: 2.1 time: 0.176707 Dec 13 23:04:58.313672 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 199/397] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:58 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:58.370397 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:04:58.370925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:58.380670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:58.381297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:58.382211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:58.382642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:58.406263 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lazy-loading 'flavor' on Instance uuid 168526af-2c4e-4e84-8b87-7f2e71d96e16 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:04:58.919346 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:58.920058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:58.927515 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:58.927960 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:58.928753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:58.929252 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:59.067941 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:59.079253 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-375e3200-fe3c-43e1-a4a9-e406bcbca2ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.163607 Dec 13 23:04:59.079877 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 200/398] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:58 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:59.084217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:59.084959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:59.091108 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:59.091563 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:59.092354 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:59.092809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:59.229028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:59.236917 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-73be936b-e4ec-4c9d-9116-0acc3ef6a9c3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1318 microversion: 2.1 time: 0.156048 Dec 13 23:04:59.237809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 201/399] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:59 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:04:59.331164 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:04:59.331880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:04:59.337895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:59.338414 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:59.339633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:04:59.340190 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:04:59.474020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:04:59.481862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db78dba0-f96f-4f1e-9ea3-027748cc4cc9 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1470 microversion: 2.1 time: 0.154312 Dec 13 23:04:59.482486 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 202/400] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:04:59 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:00.096597 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:00.097385 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:00.103951 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:00.104632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:00.105437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:00.105866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:00.334524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:00.345377 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3fabf1de-629d-4e1e-9fd1-4425e4c0250f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.252691 Dec 13 23:05:00.355739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 203/401] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:00 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:00.359013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:00.359791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:00.366169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:00.366589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:00.367618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:00.368080 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:00.610367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:00.618540 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c4ce351a-4909-4e04-8146-30c03884eab8 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1508 microversion: 2.1 time: 0.263741 Dec 13 23:05:00.619100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 204/402] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:00 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:00.623508 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f79237ed-2bb3-4312-a255-784fbc38b4f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc926fc5-6ad0-44bd-a526-2d789c182d65"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:00.624679 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f79237ed-2bb3-4312-a255-784fbc38b4f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:00.630775 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f79237ed-2bb3-4312-a255-784fbc38b4f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:00.631225 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f79237ed-2bb3-4312-a255-784fbc38b4f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:00.631998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f79237ed-2bb3-4312-a255-784fbc38b4f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:00.632397 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f79237ed-2bb3-4312-a255-784fbc38b4f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:01.053533 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f79237ed-2bb3-4312-a255-784fbc38b4f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433217 Dec 13 23:05:01.054144 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 205/403] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:05:00 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:01.059899 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:01.060590 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:01.066777 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:01.067217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:01.067992 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:01.068420 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:01.105375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:01.105984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:01.106325 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lazy-loading 'fault' on Instance uuid 75f6b1de-5be0-4140-8450-4837220d3ddc {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:01.156242 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab16702411242ffa61579e585a1bf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b04bc9649f42f397afedbb1c478345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:01.163779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cd835323-5a98-4cc5-a70c-4c55e97344a2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 200 len: 1305 microversion: 2.1 time: 0.107934 Dec 13 23:05:01.164382 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 206/404] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:01 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:01.168696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-4c16791c-3505-460a-a721-344fd274f239 req-27871829-af23-4338-a4ce-83a5ecd97bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f6b1de-5be0-4140-8450-4837220d3ddc", "name": "network-vif-deleted", "tag": "77c0d7f8-a569-4cac-82a4-f32e4db4ad60"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:01.170345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:05:01.170345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:05:01.177791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-4c16791c-3505-460a-a721-344fd274f239 req-27871829-af23-4338-a4ce-83a5ecd97bf7 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:01.178464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-4c16791c-3505-460a-a721-344fd274f239 req-27871829-af23-4338-a4ce-83a5ecd97bf7 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:01.188924 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-4c16791c-3505-460a-a721-344fd274f239 req-27871829-af23-4338-a4ce-83a5ecd97bf7 service nova] Creating event network-vif-deleted:77c0d7f8-a569-4cac-82a4-f32e4db4ad60 for instance 75f6b1de-5be0-4140-8450-4837220d3ddc on hv-cinder-79628 Dec 13 23:05:01.193847 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-4c16791c-3505-460a-a721-344fd274f239 req-27871829-af23-4338-a4ce-83a5ecd97bf7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028308 Dec 13 23:05:01.194409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 207/405] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:05:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:01.364041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:01.364738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:01.371620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:01.372000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:01.372783 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:01.373218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:01.769037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:01.777015 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ebcac94f-f13f-4104-86a1-20dac0bfa271 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.417574 Dec 13 23:05:01.777630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 208/406] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:01 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:02.053367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-42366e85-069b-4642-b21e-fecf2d584900 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6728cc4e-5886-4400-a037-df21fb4310f0"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:02.054493 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-42366e85-069b-4642-b21e-fecf2d584900 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:02.061675 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42366e85-069b-4642-b21e-fecf2d584900 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:02.062105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42366e85-069b-4642-b21e-fecf2d584900 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:02.062872 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42366e85-069b-4642-b21e-fecf2d584900 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:02.063293 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-42366e85-069b-4642-b21e-fecf2d584900 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:02.338934 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-42366e85-069b-4642-b21e-fecf2d584900 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "POST /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291007 Dec 13 23:05:02.339664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 209/407] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:05:02 2021] POST /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:02.344390 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:02.345061 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] [instance: 75f6b1de-5be0-4140-8450-4837220d3ddc] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:02.352358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:02.352796 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:02.353614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:02.354032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:02.367500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] HTTP exception thrown: Instance 75f6b1de-5be0-4140-8450-4837220d3ddc could not be found. Dec 13 23:05:02.368100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] Returning 404 to user: Instance 75f6b1de-5be0-4140-8450-4837220d3ddc could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:02.368905 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-07e83f3a-9711-4418-9a10-117918910ca2 tempest-VolumesNegativeTest-44911175 tempest-VolumesNegativeTest-44911175-project] 10.222.0.13 "GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc" status: 404 len: 111 microversion: 2.1 time: 0.028187 Dec 13 23:05:02.369642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 210/408] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:02 2021] GET /compute/v2.1/servers/75f6b1de-5be0-4140-8450-4837220d3ddc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:05:02.794287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:02.794902 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:02.802517 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:02.803217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:02.804129 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:02.806369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:02.953104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:02.960954 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-81e22758-7305-4fa2-bd14-ac85802bb86a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.170368 Dec 13 23:05:02.961568 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 211/409] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:02 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:03.978533 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:03.979207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:03.985985 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:03.986439 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:03.987219 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:03.987657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:04.126972 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:04.138680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-96cf4208-84d1-418b-839e-45af24fc797f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.163717 Dec 13 23:05:04.139351 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 212/410] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:03 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:05.159433 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:05.160354 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:05.169066 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:05.169556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:05.170355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:05.170785 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:05.304742 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:05.312461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-38870599-d63e-4c49-81d1-fb88dc1c2681 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.158803 Dec 13 23:05:05.313025 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 213/411] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:05 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:06.331810 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:06.332470 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:06.339191 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:06.339626 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:06.340390 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:06.340812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:06.477946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:06.486547 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dde61c32-b495-49d6-8c43-2a27e2776769 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.158495 Dec 13 23:05:06.487110 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 214/412] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:06 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:07.504013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:07.504876 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:07.512290 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:07.512738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:07.513554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:07.514027 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:07.659269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:07.667207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a9475317-be73-4dcf-975a-e16af3d63647 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.167297 Dec 13 23:05:07.667746 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 215/413] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:07 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:08.564222 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-12609555-631a-4252-ae19-e9700a623de8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:08.573023 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-12609555-631a-4252-ae19-e9700a623de8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:08.573544 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-12609555-631a-4252-ae19-e9700a623de8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:08.637466 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-12609555-631a-4252-ae19-e9700a623de8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Going to try to stop instance {{(pid=116226) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 13 23:05:08.680314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-12609555-631a-4252-ae19-e9700a623de8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 202 len: 0 microversion: 2.1 time: 0.122093 Dec 13 23:05:08.680973 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 216/414] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:05:08 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:05:08.686091 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:08.686866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:08.693197 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:08.693645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:08.694465 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:08.694891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:08.836970 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:08.845034 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-818ed919-541f-466a-a201-8c6bb29875b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.162835 Dec 13 23:05:08.846014 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 217/415] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:08 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:08.850334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:08.850924 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:08.858146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:08.858696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:08.859765 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:08.860408 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:09.006271 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:09.015084 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cdfd6e6c-e4d3-41e8-86cd-dd8d4e684b98 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.167883 Dec 13 23:05:09.015582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 218/416] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:08 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:09.862289 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:09.862996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:09.869982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:09.870425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:09.871196 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:09.871622 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:10.011852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:10.019826 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cf219a6f-392d-422c-b7c2-cfb0cfce41cf tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.161252 Dec 13 23:05:10.020430 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 219/417] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:09 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:10.034961 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:10.035764 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:10.044258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:10.044802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:10.045853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:10.046463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:10.192566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:10.200800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e43d32e9-fe29-4ea3-8707-f0d9f712a41f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.171229 Dec 13 23:05:10.201516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 220/418] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:10 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:11.039054 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:11.039716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:11.046461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:11.047003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:11.047775 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:11.048203 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:11.184375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:11.192541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-aa671ad2-7908-4411-853c-72831d7d746e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.157240 Dec 13 23:05:11.193104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 221/419] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:11 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:11.218715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:11.219365 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:11.225812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:11.226258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:11.227031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:11.227456 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:11.363428 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:11.371654 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-919a51b4-dad4-402c-a069-9760ff5b5e25 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.156389 Dec 13 23:05:11.372221 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 222/420] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:11 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:12.213984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:12.214969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:12.223056 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:12.223495 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:12.224304 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:12.224730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:12.370600 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:12.382188 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f5489638-a2cc-4f6c-bad1-de4eecc94074 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.174240 Dec 13 23:05:12.382866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 223/421] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:12 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:12.390699 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:12.391298 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:12.396963 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:12.397413 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:12.398197 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:12.398618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:12.531204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:12.539001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fd7417c2-bbd3-48bf-a206-fb8a83cebd64 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.153432 Dec 13 23:05:12.539556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 224/422] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:12 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:13.405478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:13.406556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:13.414264 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:13.414772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:13.415605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:13.416028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:13.557923 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:13.565362 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-21ab6d74-2840-4e54-b7c0-79e347598b13 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.166050 Dec 13 23:05:13.565920 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 225/423] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:13 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:13.570030 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:13.570629 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:13.575938 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:13.576378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:13.577133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:13.577606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:13.715763 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:13.724337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-628afa8a-da62-418b-af6f-87145ba7de04 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.157494 Dec 13 23:05:13.724884 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 226/424] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:13 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:14.582062 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:14.582735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:14.589602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:14.590049 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:14.590834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:14.591267 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:14.731583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:14.739465 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8a1473d0-62f4-46c4-9ea5-566a84ea7c27 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.161369 Dec 13 23:05:14.740184 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 227/425] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:14 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:14.744543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:14.745140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:14.750842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:14.751288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:14.752050 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:14.752476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:14.888287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:14.897908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4ec21b90-f2ad-44d6-a4c5-0ebe6043e5b7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.156789 Dec 13 23:05:14.898479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 228/426] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:14 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:15.758051 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:15.758663 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:15.764995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:15.765485 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:15.766266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:15.766671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:15.904309 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:15.912413 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9d7c67ec-9e60-4ef5-befa-b099c619f44f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.158512 Dec 13 23:05:15.913215 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 229/427] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:15 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:15.918210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:15.918812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:15.924956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:15.925429 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:15.926209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:15.927038 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:16.063803 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:16.071692 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8cad18d0-a52d-4fd6-a1db-a8e4e0214698 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.157467 Dec 13 23:05:16.072236 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 230/428] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:15 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:16.325699 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:16.326154 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:16.335153 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:16.335640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:16.337162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:16.337884 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:16.480122 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lazy-loading 'services' on Instance uuid 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:16.606399 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a629753c-150e-4cab-bb30-e8a9c0e3ea31 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments/6728cc4e-5886-4400-a037-df21fb4310f0" status: 202 len: 0 microversion: 2.1 time: 0.286568 Dec 13 23:05:16.607056 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 231/429] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:05:16 2021] DELETE /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments/6728cc4e-5886-4400-a037-df21fb4310f0 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:05:16.616434 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ba742b89-2e57-4240-8410-6bcc0d7f3eb1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:16.617876 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ba742b89-2e57-4240-8410-6bcc0d7f3eb1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:16.624948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba742b89-2e57-4240-8410-6bcc0d7f3eb1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:16.624948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba742b89-2e57-4240-8410-6bcc0d7f3eb1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:16.625697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba742b89-2e57-4240-8410-6bcc0d7f3eb1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:16.626115 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba742b89-2e57-4240-8410-6bcc0d7f3eb1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:16.658581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ba742b89-2e57-4240-8410-6bcc0d7f3eb1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046884 Dec 13 23:05:16.663139 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 232/430] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:05:16 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:05:16.932564 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:16.933233 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:16.939649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:16.940085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:16.940851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:16.941297 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:17.085643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:17.093369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d62c0c07-49a2-4630-ba74-6085fecf50d6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.165960 Dec 13 23:05:17.093949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 233/431] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:16 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:17.098142 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:17.098732 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:17.104730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:17.105173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:17.106001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:17.106427 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:17.259342 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:17.267348 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f71d200e-ef9b-41d2-9b0e-b71279b65cd1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.172455 Dec 13 23:05:17.267924 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 234/432] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:17 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:17.656931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-afc2e423-c91e-4da2-86e0-c68bfe50e274 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 202 len: 0 microversion: 2.20 time: 19.290843 Dec 13 23:05:17.658332 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 199/433] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:04:58 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 0 bytes in 19293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:05:17.670106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:17.670887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:17.679442 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:17.680165 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:17.680964 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:17.686262 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f5ffc765-0789-4732-9db5-34ae2cff7d6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:17.687276 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f5ffc765-0789-4732-9db5-34ae2cff7d6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:17.690603 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:17.708045 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f5ffc765-0789-4732-9db5-34ae2cff7d6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:17.708479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f5ffc765-0789-4732-9db5-34ae2cff7d6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:17.709269 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f5ffc765-0789-4732-9db5-34ae2cff7d6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:17.712340 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f5ffc765-0789-4732-9db5-34ae2cff7d6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:17.754469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f5ffc765-0789-4732-9db5-34ae2cff7d6f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079081 Dec 13 23:05:17.757483 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 200/434] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:05:17 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:05:17.871145 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:17.881642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:17.883570 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:17.884752 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b8bb2a58-a9c5-4af0-a13f-8fe52ae527b8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.221497 Dec 13 23:05:17.885805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 235/435] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:17 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:05:18.110800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:18.111397 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:18.118389 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.119040 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:18.119851 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.120293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:18.263404 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:18.277663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a17dbe81-72ee-42f4-a301-ec026cf0bc84 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.170703 Dec 13 23:05:18.278241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 201/436] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:18 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:18.284840 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:18.285493 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:18.292237 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.292735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:18.293566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.294058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:18.437604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:18.446429 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-735431c8-19ba-4f5c-989d-ee156e77b080 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.165148 Dec 13 23:05:18.447182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 236/437] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:18 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:18.907294 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:18.907922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:18.914767 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.915209 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:18.916119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.916746 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:18.969833 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:18.970281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:18.976786 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.977517 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:18.979181 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:18.979812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:19.007163 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:05:19.086274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:19.088173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-eaebdb54-3088-4741-86f7-78c2f071e042 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 204 len: 0 microversion: 2.1 time: 0.122268 Dec 13 23:05:19.089272 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 237/438] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:05:18 2021] DELETE /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:05:19.097322 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:19.097744 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:19.098450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:19.098778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:19.099925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e21c0e65-c0ef-441e-afc7-4f43ef9b24de tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.196583 Dec 13 23:05:19.107441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 202/439] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:18 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:19.107581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:19.107581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:19.107581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:19.107581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:19.258426 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:19.266618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-238bd8d3-6d13-430a-aa41-e869d42fcf2a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1514 microversion: 2.1 time: 0.172979 Dec 13 23:05:19.267192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 238/440] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:19 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:19.296756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:19.296756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:19.302248 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:19.302739 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:19.303466 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:19.303987 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:19.439834 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:19.447602 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d92bbbbe-99e9-4c52-afeb-a2c9e0619369 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.156745 Dec 13 23:05:19.448165 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 203/441] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:19 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:19.462955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:19.463532 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:19.469961 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:19.470425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:19.471265 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:19.471697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:19.608373 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:19.616927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e0e15f26-d98f-475f-8cdd-37b0b88036bc tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.157177 Dec 13 23:05:19.617570 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 239/442] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:19 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:20.119569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:20.120214 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:20.127379 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.127820 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.128623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.129059 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.268223 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:20.277102 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:20.278935 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:20.280315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f292b4ff-c1ef-4d89-9406-dbc3fc575d0e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.165020 Dec 13 23:05:20.289999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 204/443] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:20 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:20.290166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:20.290166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:20.291366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.291834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.292605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.293026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.431694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:20.439603 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c6e04785-8429-420f-877a-c33b23d5ef57 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1514 microversion: 2.1 time: 0.158951 Dec 13 23:05:20.440218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 240/444] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:20 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:20.464193 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:20.464831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:20.471491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.471938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.472721 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.473155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.610628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:20.619238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-147493c7-702e-46ec-b6ad-7634f36871b5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.159036 Dec 13 23:05:20.619768 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 205/445] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:20 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:20.634086 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:20.634713 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:20.641422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.641869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.642649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:20.643080 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:20.784628 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:20.795012 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-076b731f-1970-4de7-92cd-b2d19b9f40a3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.164658 Dec 13 23:05:20.795602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 241/446] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:20 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:21.302931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:21.303953 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:21.310979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.311422 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:21.312196 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.312603 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:21.447799 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:21.456041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:21.456233 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:21.456667 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:21.457628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:21.459047 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f70f5f79-ed42-4d6b-9656-e1a5d9e4680f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.162678 Dec 13 23:05:21.459779 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 206/447] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:21 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:21.463254 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.463727 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:21.464482 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.465075 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:21.601241 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:21.609163 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-55681586-cdf4-4fc4-b805-f601c3c1d189 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1514 microversion: 2.1 time: 0.156904 Dec 13 23:05:21.609772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 242/448] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:21 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:21.636179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:21.636786 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:21.642954 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.643395 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:21.644173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.644597 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:21.804225 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:21.812762 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:21.814518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:21.816099 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0478718a-c26e-46f5-adba-6c234bc1dbba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.183853 Dec 13 23:05:21.817368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 207/449] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:21 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:21.821750 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.822131 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:21.823325 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:21.824173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.087874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:22.098329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-be5147a7-a6ff-456e-9fbb-d27e43d7a6a8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.289287 Dec 13 23:05:22.101503 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 243/450] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:21 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:22.379367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-2efff934-e4d1-4df7-a522-bd54ae3dc1f8 req-3a2a652b-1f68-43eb-b32e-d41f6e3fce66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a", "name": "network-vif-deleted", "tag": "02c6fedf-f723-4463-8f11-189373d87d07"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:22.380936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:05:22.380936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:05:22.388490 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-2efff934-e4d1-4df7-a522-bd54ae3dc1f8 req-3a2a652b-1f68-43eb-b32e-d41f6e3fce66 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.388938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-2efff934-e4d1-4df7-a522-bd54ae3dc1f8 req-3a2a652b-1f68-43eb-b32e-d41f6e3fce66 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.401621 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-2efff934-e4d1-4df7-a522-bd54ae3dc1f8 req-3a2a652b-1f68-43eb-b32e-d41f6e3fce66 service nova] Creating event network-vif-deleted:02c6fedf-f723-4463-8f11-189373d87d07 for instance 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a on hv-cinder-79628 Dec 13 23:05:22.406332 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-2efff934-e4d1-4df7-a522-bd54ae3dc1f8 req-3a2a652b-1f68-43eb-b32e-d41f6e3fce66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030565 Dec 13 23:05:22.406959 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 208/451] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:05:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:22.478104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:22.478712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:22.484528 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.485210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.486227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.486737 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.626884 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:22.627722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:22.634049 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.634503 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.635300 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.635734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.652605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:22.660530 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:22.662091 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:22.663239 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8dc773bd-111e-4a41-b903-7112be9bf771 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.188936 Dec 13 23:05:22.664048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 244/452] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:22 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:22.677769 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.678186 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.678628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lazy-loading 'fault' on Instance uuid 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:22.722873 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:22.730507 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-97033eca-fa03-41ef-9a9b-814a23ba43f0 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 200 len: 1308 microversion: 2.1 time: 0.107970 Dec 13 23:05:22.731216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 209/453] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:22 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:22.833649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:22.834271 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:22.840887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.841646 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.842573 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:22.843133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:22.996706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:23.009280 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5f7b5c7a-cdc7-4dc6-bda1-53532372ef42 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.179236 Dec 13 23:05:23.019735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 245/454] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:22 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:23.121368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:23.122336 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:23.128877 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:23.136697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:23.136697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:23.136697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:23.374371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:23.382674 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0bd443e4-d153-4a3f-af53-74770b5598e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.268144 Dec 13 23:05:23.383654 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 210/455] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:23 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:23.683244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:23.683890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:23.690272 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:23.690970 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:23.691969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:23.692395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:23.747660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:23.748277 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:23.755007 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:23.755449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:23.756218 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:23.756640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:23.770808 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] HTTP exception thrown: Instance 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a could not be found. Dec 13 23:05:23.771527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Returning 404 to user: Instance 6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:23.772361 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-833e96a3-23af-401b-b2f8-f621646a2db7 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a" status: 404 len: 111 microversion: 2.1 time: 0.028905 Dec 13 23:05:23.772922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 211/456] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:23 2021] GET /compute/v2.1/servers/6ce6e711-46f5-47d1-9d2b-9551a3e2fa4a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 13 23:05:23.921969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:23.932481 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:23.934679 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:23.936209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dcf71d85-2eae-45af-b6af-a9c49f78fefe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.257314 Dec 13 23:05:23.968115 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 246/457] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:23 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:05:24.026831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:24.027668 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:24.033795 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.034438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.035920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.036502 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.320866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:24.330432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ccff5b15-5929-4798-bfc4-749ab9029936 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.307864 Dec 13 23:05:24.340664 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 212/458] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:24 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:24.400446 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:24.401454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:24.407807 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.408253 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.409268 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.409722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.700953 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:24.710349 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f9bfa090-7483-4d99-87ac-ff90084d1e92 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.314088 Dec 13 23:05:24.710987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 247/459] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:24 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:24.939352 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:24.939944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:24.946891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.948119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.948986 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.949430 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.958515 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:24.958515 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:24.962860 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.964041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.970776 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:24.971218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:24.995790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:05:25.131186 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a6dbb343-6663-45c8-a3a4-1d9494b34cc5 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 204 len: 0 microversion: 2.1 time: 0.195288 Dec 13 23:05:25.131776 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 213/460] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:05:24 2021] DELETE /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:05:25.148623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:25.149105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:25.162081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:25.162704 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:25.164125 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:25.164719 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:25.325269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:25.345044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:25.347202 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:25.349246 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8c3ea3e1-83fe-4b1a-86db-664999ebdc21 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.397442 Dec 13 23:05:25.350686 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 248/461] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:24 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:05:25.381304 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:25.382217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:25.390524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:25.391260 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:25.392227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:25.392804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:25.581274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:25.597065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7d8cea51-285e-4849-9471-4560d56acb6a tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1514 microversion: 2.1 time: 0.459898 Dec 13 23:05:25.599707 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 214/462] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:25 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:25.708381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:25.732889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-62ecf3c7-20f4-4a17-8aa5-9f5c769e0a3c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.346769 Dec 13 23:05:25.732889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 249/463] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:25 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:25.733077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:25.733077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:25.749096 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:25.749651 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:25.750475 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:25.750902 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:25.965955 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:25.974251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-df948406-46ef-459f-ba8a-c87e6f476e57 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.246694 Dec 13 23:05:25.982833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 215/464] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:25 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:26.359682 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d61ad5a6-d1a7-431b-8714-de985355b522 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6193452b-2224-4a75-a5d2-ac2e0390ac56", "device": "/dev/sdb"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:26.361311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d61ad5a6-d1a7-431b-8714-de985355b522 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:26.367789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:26.368440 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:26.369299 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61ad5a6-d1a7-431b-8714-de985355b522 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.369850 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61ad5a6-d1a7-431b-8714-de985355b522 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.370645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61ad5a6-d1a7-431b-8714-de985355b522 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.371074 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d61ad5a6-d1a7-431b-8714-de985355b522 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.375986 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.376679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.377709 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.378318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.555371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:26.563806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:26.566927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:26.568411 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ecb8edf5-0096-42d3-bdb5-0895ef5a9894 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.204404 Dec 13 23:05:26.569054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 216/465] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:26 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:05:26.619489 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:26.620443 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:26.640048 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.640512 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.641656 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.647523 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.650510 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d61ad5a6-d1a7-431b-8714-de985355b522 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "POST /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294075 Dec 13 23:05:26.654286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 250/466] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:05:26 2021] POST /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:26.750598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:26.751334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:26.760060 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.768735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.770881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:26.771334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:26.828024 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:26.838355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d4331369-ad67-4ba4-8426-a24e17a4b0ad tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1514 microversion: 2.1 time: 0.224687 Dec 13 23:05:26.839448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 217/467] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:26 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:26.982264 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:26.990857 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:26.991338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-76906b46-d9e9-4cc4-be08-61725d4f66cd tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.245090 Dec 13 23:05:26.992096 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:26.995737 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 251/468] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:26 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:27.009988 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:27.010524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:27.011328 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:27.011755 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:27.239984 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:27.248970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ccc20e86-a595-4f0a-a32e-6d300b6399d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.261590 Dec 13 23:05:27.250827 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 218/469] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:26 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:27.591477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:27.592977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:27.605773 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:27.606278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:27.607153 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:27.607620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:27.853382 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:27.863469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:27.865512 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:27.866551 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:27.867421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:27.871391 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-eaec7beb-7aea-44fa-9ec7-6254c88bb2b9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.286342 Dec 13 23:05:27.873780 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:27.874388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:27.874627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 252/470] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:27 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:27.875516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:27.876093 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:28.010903 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:28.011546 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:28.022653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:28.023103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:28.023915 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:28.024350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:28.310991 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:28.330585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7a7dbca2-dc77-4cda-aeca-7b38d0da97df tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 200 len: 1514 microversion: 2.1 time: 0.473762 Dec 13 23:05:28.332682 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 219/471] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:27 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 1514 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:28.339662 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-7db4085f-42d1-406b-a05b-bfa6cbcc98ae req-89867481-95b3-49e0-b96a-640a3042aa9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66106e4e-2ac2-4866-a07d-20f05ada9bf8", "name": "network-vif-deleted", "tag": "f7385e78-ed70-42a9-bf3a-1245a3993ec0"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:28.342858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:05:28.342858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:05:28.356840 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-7db4085f-42d1-406b-a05b-bfa6cbcc98ae req-89867481-95b3-49e0-b96a-640a3042aa9e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:28.357569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-7db4085f-42d1-406b-a05b-bfa6cbcc98ae req-89867481-95b3-49e0-b96a-640a3042aa9e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:28.395245 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-7db4085f-42d1-406b-a05b-bfa6cbcc98ae req-89867481-95b3-49e0-b96a-640a3042aa9e service nova] Creating event network-vif-deleted:f7385e78-ed70-42a9-bf3a-1245a3993ec0 for instance 66106e4e-2ac2-4866-a07d-20f05ada9bf8 on hv-cinder-79628 Dec 13 23:05:28.419920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-7db4085f-42d1-406b-a05b-bfa6cbcc98ae req-89867481-95b3-49e0-b96a-640a3042aa9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082805 Dec 13 23:05:28.421463 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 220/472] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:05:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:28.434401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:28.435174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:28.447100 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:28.448244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:28.449249 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:28.449880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:28.482584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:28.490969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b43908e5-ad9f-44c3-afc7-af83f6c97f8f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.484617 Dec 13 23:05:28.500836 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 253/473] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:28 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:28.626819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:28.636821 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-93157161-559b-44c1-8b29-c346d03d40fa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1722 microversion: 2.1 time: 0.214042 Dec 13 23:05:28.637776 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 221/474] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:28 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:28.892820 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:28.893542 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:28.900255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:28.901150 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:28.902616 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:28.903204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.052822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:29.062535 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:29.064643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:29.066041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-73965316-2596-4a63-a1c5-7410e08b4f50 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.177401 Dec 13 23:05:29.066948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 254/475] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:28 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:29.348265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:29.348880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 66106e4e-2ac2-4866-a07d-20f05ada9bf8] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:29.355505 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.355953 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.356742 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.357174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.370689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] HTTP exception thrown: Instance 66106e4e-2ac2-4866-a07d-20f05ada9bf8 could not be found. Dec 13 23:05:29.371744 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Returning 404 to user: Instance 66106e4e-2ac2-4866-a07d-20f05ada9bf8 could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:29.372669 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-30ec50e8-a2fb-44a0-b386-27761e40a254 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8" status: 404 len: 111 microversion: 2.1 time: 0.028383 Dec 13 23:05:29.373315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 222/476] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:29 2021] GET /compute/v2.1/servers/66106e4e-2ac2-4866-a07d-20f05ada9bf8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:05:29.381322 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:29.381931 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:29.388527 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.389048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.389887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.390534 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.424930 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:05:29.508601 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:29.509289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:29.518784 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.521239 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.522129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.522573 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.546281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c3e9b524-ec19-4fdf-9cab-e96f335d8b86 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "DELETE /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 204 len: 0 microversion: 2.1 time: 0.168081 Dec 13 23:05:29.548568 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 255/477] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:05:29 2021] DELETE /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:05:29.559202 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:29.560343 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:29.568108 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.569640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.570983 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.571914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.780474 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:29.792387 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ca329653-39ba-4252-bfa4-67dd90746bbe tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1522 microversion: 2.1 time: 0.288192 Dec 13 23:05:29.808511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:29.816911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 223/478] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:29 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:29.818715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c5addc0f-4a9f-4055-8e6a-d9261e3c0268 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1515 microversion: 2.1 time: 0.264959 Dec 13 23:05:29.819685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 256/479] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:29 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:29.822908 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:29.823511 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:29.833137 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.833661 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:29.834462 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:29.834896 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.085607 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:30.087002 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:30.095590 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.096033 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.097185 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.097841 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.146409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:30.159194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-82693548-7f99-4fa1-b1e8-74698a022854 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1699 microversion: 2.1 time: 0.340508 Dec 13 23:05:30.175192 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 224/480] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:29 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1699 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:30.182244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8329e9bd-6a44-47da-a6b1-852cfb022e0e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:30.191454 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8329e9bd-6a44-47da-a6b1-852cfb022e0e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.192274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8329e9bd-6a44-47da-a6b1-852cfb022e0e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.273081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8329e9bd-6a44-47da-a6b1-852cfb022e0e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Going to try to start instance {{(pid=116225) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 13 23:05:30.326308 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8329e9bd-6a44-47da-a6b1-852cfb022e0e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 202 len: 0 microversion: 2.1 time: 0.149184 Dec 13 23:05:30.330417 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 225/481] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:05:30 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:05:30.339086 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:30.340167 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:30.348419 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.349106 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.349917 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.350672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.416877 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:30.426220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:30.428912 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:30.431205 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5aff7ec2-de03-4fd6-bff3-eb4d5ac29619 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.350026 Dec 13 23:05:30.443574 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 257/482] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:30 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:30.627583 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:30.637572 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bbb81d91-0ddb-43e0-9137-95c959db19e7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1708 microversion: 2.1 time: 0.303708 Dec 13 23:05:30.648531 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 226/483] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:30 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1708 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:30.824042 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:30.824995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:30.837772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.838195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:30.838751 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.838888 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:30.839987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.840835 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.850026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.850951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:30.851970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:30.852561 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:31.917411 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:31.929471 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d1eeabd3-ac9a-498e-a836-80238ab3c5ba tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1502 microversion: 2.1 time: 1.109447 Dec 13 23:05:31.930012 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 258/484] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:30 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1502 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:31.945614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:31.946295 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:31.962757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:31.963355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:31.964036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:31.964458 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:31.984920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:31.994539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2d221df5-16b7-4dab-a47a-af513a03a81e tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1515 microversion: 2.1 time: 1.160726 Dec 13 23:05:31.995120 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 227/485] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:30 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1515 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:31.999761 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:32.000556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:32.007270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:32.007947 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:32.009058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:32.009723 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:32.577541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:32.589264 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:32.593555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:32.598473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bae1e91f-e543-48d4-b40a-34fb627e319a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.667283 Dec 13 23:05:32.600851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 259/486] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:31 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:32.616082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:32.617068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:32.627161 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:32.627945 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:32.630523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:32.631217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:32.688794 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:32.700143 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6426a458-b3dd-4edc-98ed-5de52b227e2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1708 microversion: 2.1 time: 0.703688 Dec 13 23:05:32.701496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 228/487] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:31 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1708 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:33.013011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:33.013775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:33.024734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:33.027462 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:33.028439 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:33.029348 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:33.035022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:33.048438 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-79b7e4ea-922e-4a16-8853-2954cef8bd31 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1515 microversion: 2.1 time: 0.445282 Dec 13 23:05:33.050771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 260/488] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:32 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:33.618663 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:33.619405 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:33.640889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:33.645987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:33.647169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:33.648743 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:33.789406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:33.802292 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5b9d4fcd-e8d8-4a2b-aacc-9a8699becc1f tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 200 len: 1515 microversion: 2.1 time: 0.794216 Dec 13 23:05:33.802889 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 229/489] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:33 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 1515 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:33.813713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:33.814336 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:33.828798 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:33.829241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:33.830106 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:33.830533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.032247 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:34.043335 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:34.046031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:34.047286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-60f4d54f-e7c4-4a1c-b560-285ba8768c91 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.432516 Dec 13 23:05:34.055393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 261/490] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:33 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:34.059853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-89e1906f-41a5-442d-b7b6-31578d32aa45 req-365744f9-1687-46bf-bc85-61f993d73f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353b59fe-6794-411b-82f2-ac6f7dba75d4", "name": "network-vif-deleted", "tag": "02ed001c-6e95-48af-96d5-9f200d0fb881"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:34.062104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:05:34.062104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:05:34.074419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-89e1906f-41a5-442d-b7b6-31578d32aa45 req-365744f9-1687-46bf-bc85-61f993d73f3d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:34.075104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-89e1906f-41a5-442d-b7b6-31578d32aa45 req-365744f9-1687-46bf-bc85-61f993d73f3d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.094360 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-89e1906f-41a5-442d-b7b6-31578d32aa45 req-365744f9-1687-46bf-bc85-61f993d73f3d service nova] Creating event network-vif-deleted:02ed001c-6e95-48af-96d5-9f200d0fb881 for instance 353b59fe-6794-411b-82f2-ac6f7dba75d4 on hv-cinder-79628 Dec 13 23:05:34.098280 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-89e1906f-41a5-442d-b7b6-31578d32aa45 req-365744f9-1687-46bf-bc85-61f993d73f3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047763 Dec 13 23:05:34.099186 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 262/491] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:05:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:34.111564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:34.119780 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-28ffe27f-a610-46f1-ba86-1f32f071b2c4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1712 microversion: 2.1 time: 0.315703 Dec 13 23:05:34.120424 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 230/492] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:33 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1712 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:34.644054 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:34.645218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:34.652166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:34.652727 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.653610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:34.654124 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.680384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lazy-loading 'flavor' on Instance uuid f930f2d2-ece8-408b-aad2-fcb48bac226d {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:34.798842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-da816faa-d53f-46c3-9f9d-fb98dbf55b0c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action" status: 200 len: 32 microversion: 2.1 time: 0.159409 Dec 13 23:05:34.799336 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 263/493] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:05:34 2021] POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:05:34.811004 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:34.812073 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:34.821859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:34.822138 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:34.822534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.823941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:34.824174 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 353b59fe-6794-411b-82f2-ac6f7dba75d4] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:34.824847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.832816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:34.833269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.834959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:34.835391 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:34.855016 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] HTTP exception thrown: Instance 353b59fe-6794-411b-82f2-ac6f7dba75d4 could not be found. Dec 13 23:05:34.855651 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Returning 404 to user: Instance 353b59fe-6794-411b-82f2-ac6f7dba75d4 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:34.856487 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-349b4a7e-f437-4a46-9e45-3d5f133e2c3b tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4" status: 404 len: 111 microversion: 2.1 time: 0.040579 Dec 13 23:05:34.865813 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 264/494] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:34 2021] GET /compute/v2.1/servers/353b59fe-6794-411b-82f2-ac6f7dba75d4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 13 23:05:34.987466 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:34.994965 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7e4ffe67-7461-4d5d-a6a0-52df25afdf62 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.188501 Dec 13 23:05:34.995546 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 231/495] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:34 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:35.067026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:35.068259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:35.075728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:35.076176 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:35.077018 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:35.077523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:35.306290 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:35.314161 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:35.315890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:35.317198 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a0269881-f7f1-4296-8f3f-b22337706789 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.254321 Dec 13 23:05:35.328428 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 265/496] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:35 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:36.013154 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:36.014291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:36.021484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:36.022388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:36.023369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:36.024014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:36.180243 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:36.188368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f9b9e19d-3c59-4e57-a4c4-b4c91645bef7 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.180160 Dec 13 23:05:36.189059 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 232/497] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:36 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:36.245806 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-80df9f55-5c84-4704-9a13-7a9e170d46ca tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Action: 'create', calling method: .version_select at 0x7f039c9563a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2137429673"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:36.267042 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-80df9f55-5c84-4704-9a13-7a9e170d46ca tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Getting quotas for project 5dd4dc022cad44d1baaa51931dfdfa31. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:05:36.271228 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-80df9f55-5c84-4704-9a13-7a9e170d46ca tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Getting quotas for user 74ed484d62ab45fea26e324f737e231c and project 5dd4dc022cad44d1baaa51931dfdfa31. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:05:36.335868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:36.336469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:36.342756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:36.343193 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:36.343965 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:36.344410 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:36.448275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-80df9f55-5c84-4704-9a13-7a9e170d46ca tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Getting quotas for project 5dd4dc022cad44d1baaa51931dfdfa31. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:05:36.452068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-80df9f55-5c84-4704-9a13-7a9e170d46ca tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Getting quotas for user 74ed484d62ab45fea26e324f737e231c and project 5dd4dc022cad44d1baaa51931dfdfa31. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:05:36.465938 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-80df9f55-5c84-4704-9a13-7a9e170d46ca tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.410201 Dec 13 23:05:36.466566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 266/498] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Dec 13 23:05:36 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:36.477451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:36.485545 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:36.487059 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:36.488286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-062fd5e0-bbb5-4e5e-80e9-23aa70ff0b66 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.156103 Dec 13 23:05:36.499928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 233/499] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:36 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:05:37.208976 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:37.209632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:37.216901 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:37.217682 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:37.218484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:37.218919 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:37.360653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:37.369469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9d1aff7e-81f0-4e69-9690-31a0d57598a3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.165212 Dec 13 23:05:37.370348 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 267/500] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:37 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:37.506914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:37.508111 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:37.515593 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:37.516481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:37.517490 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:37.518248 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:37.748072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:37.766197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:37.770878 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:37.774066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-03101e2b-c293-462f-aa49-d400b695790c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.270828 Dec 13 23:05:37.774976 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 234/501] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:37 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:38.159415 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:38.160194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:38.174420 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.174866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.175688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.180360 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.230501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:05:38.355416 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8643212b-dab3-46fb-9982-49706d539ff3 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 204 len: 0 microversion: 2.1 time: 0.199070 Dec 13 23:05:38.359883 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 268/502] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:05:38 2021] DELETE /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:05:38.366040 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:38.366665 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:38.375670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.377408 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.382085 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.382726 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.387479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:38.388299 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:38.395755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.396298 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.397179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.397758 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.641026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:38.643477 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:38.650538 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8ffc803f-9429-47f7-a65d-530eb19a92b4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.267478 Dec 13 23:05:38.652971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-115c32a9-8a7e-4971-9e1f-9537f31b3456 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1515 microversion: 2.1 time: 0.291863 Dec 13 23:05:38.653962 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 269/503] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:38 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:38.665963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 235/504] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:38 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1515 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:38.796859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:38.797798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:38.806968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.807706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.808654 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:38.809442 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:38.971557 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:38.979618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:38.981101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:38.982278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a85ede09-f963-443e-b671-154e722aef58 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.191986 Dec 13 23:05:38.982838 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 270/505] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:38 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:39.669989 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:39.671065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:39.672383 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:39.673003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:39.678046 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:39.678453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:39.679267 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:39.679687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:39.680053 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:39.680469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:39.681624 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:39.682502 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:39.880989 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:39.884464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:39.895521 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d5db9981-1b55-415f-a6e0-339cbf03cd9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.226813 Dec 13 23:05:39.896172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 271/506] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:39 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:39.898722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-61c86095-6a01-4f15-928c-5c50794f8a44 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1515 microversion: 2.1 time: 0.232312 Dec 13 23:05:39.899291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 236/507] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:39 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:40.001918 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:40.002712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:40.009634 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:40.010075 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:40.011043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:40.011260 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:40.154218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:40.161978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:40.163489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:40.164623 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db148324-da39-40ac-b8b9-9eb879e8e14f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.166494 Dec 13 23:05:40.165301 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 272/508] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:39 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:40.913953 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:40.914529 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:40.916281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:40.917409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:40.921275 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:40.921737 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:40.922567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:40.922970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:40.924255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:40.924697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:40.925525 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:40.925952 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:41.120796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:41.125391 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:41.128895 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a64cff85-7057-4b06-b229-ec1715bae2f0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.219206 Dec 13 23:05:41.129709 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 237/509] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:40 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:41.133811 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-56014b08-b243-42c6-9cd5-915b4d749598 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1515 microversion: 2.1 time: 0.221896 Dec 13 23:05:41.146996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 273/510] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:40 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:41.184156 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:41.184694 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:41.190554 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:41.191000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:41.191760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:41.192184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:41.333173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:41.345484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:41.347768 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:41.349656 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d0fe64a2-2986-49be-9aac-c88a542c6804 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.169064 Dec 13 23:05:41.350466 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 238/511] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:41 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:42.150694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:42.151414 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:42.153466 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:42.154119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:42.158922 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:42.159371 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:42.160139 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:42.160567 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:42.160679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:42.161084 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:42.161901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:42.162363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:42.356430 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:42.363907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:42.364302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-08023eb8-5e22-4607-9021-14b4ba3cc9de tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.217435 Dec 13 23:05:42.365365 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 274/512] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:42 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:42.369900 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:42.370488 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:42.373029 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-daaf0859-4c5c-4eba-96d4-c6be33f38be1 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1515 microversion: 2.1 time: 0.223242 Dec 13 23:05:42.373762 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 239/513] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:42 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:42.376895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:42.377456 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:42.378274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:42.378707 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:42.529137 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:42.537513 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:42.539058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:42.540232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6f94ad82-24b3-4b3a-8c78-d91bd393e9f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.174055 Dec 13 23:05:42.540798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 275/514] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:42 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:43.194449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-de02ebbb-78b4-4fed-bca4-59374fc8cc76 req-ca71948f-667d-469d-820c-2a2dbd91b14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d21621-3cd9-4755-8588-0e8cb988d280", "name": "network-vif-deleted", "tag": "9f7d1643-23b1-4ec2-997f-a41eed0290e7"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:43.197020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:05:43.197020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:05:43.206232 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-de02ebbb-78b4-4fed-bca4-59374fc8cc76 req-ca71948f-667d-469d-820c-2a2dbd91b14e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.206667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-de02ebbb-78b4-4fed-bca4-59374fc8cc76 req-ca71948f-667d-469d-820c-2a2dbd91b14e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.218452 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-de02ebbb-78b4-4fed-bca4-59374fc8cc76 req-ca71948f-667d-469d-820c-2a2dbd91b14e service nova] Creating event network-vif-deleted:9f7d1643-23b1-4ec2-997f-a41eed0290e7 for instance 50d21621-3cd9-4755-8588-0e8cb988d280 on hv-cinder-79628 Dec 13 23:05:43.224074 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-de02ebbb-78b4-4fed-bca4-59374fc8cc76 req-ca71948f-667d-469d-820c-2a2dbd91b14e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Dec 13 23:05:43.224924 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 240/515] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:05:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:43.382503 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:43.383107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:43.390059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.390508 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.391090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:43.391330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.391734 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.392165 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:43.398802 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.399225 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.400006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.400428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.431895 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.432449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.432986 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lazy-loading 'fault' on Instance uuid 50d21621-3cd9-4755-8588-0e8cb988d280 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:43.486070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:43.493290 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1606859f-c323-4550-b473-561e52659e40 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1308 microversion: 2.1 time: 0.106820 Dec 13 23:05:43.493884 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 241/516] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:43 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:43.557987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:43.559818 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:43.560422 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:43.565897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9c0e2783-411b-422f-a696-511b25da7294 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.187027 Dec 13 23:05:43.566486 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 276/517] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:43 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:43.566670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.567081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.567875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:43.568298 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:43.703732 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:43.715231 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:43.718173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:43.719867 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1f1621d1-4376-427a-907b-4bcd114ccfad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.163572 Dec 13 23:05:43.720636 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 242/518] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:43 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:44.511350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:44.511957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:44.518828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:44.519272 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:44.520051 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:44.520473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:44.554482 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:44.554927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:44.555366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lazy-loading 'fault' on Instance uuid 50d21621-3cd9-4755-8588-0e8cb988d280 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:44.582884 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:44.583794 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:44.591070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:44.592218 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:44.593086 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:44.593793 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:44.596150 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:44.604703 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-153a6303-367d-403c-8288-a35031601d80 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1308 microversion: 2.1 time: 0.096941 Dec 13 23:05:44.611755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 277/519] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:44 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:44.739166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:44.740904 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:44.742579 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:44.747996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:44.748475 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:44.749245 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:44.749701 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:44.752183 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1abf6e9d-ad93-437a-94fa-6f0ac3e24245 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.172974 Dec 13 23:05:44.752749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 243/520] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:44 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:44.881869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:44.904001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:44.904001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:44.904001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-17b4b9a9-003c-4bd0-b13f-8685483aef9b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.168578 Dec 13 23:05:44.904641 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 278/521] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:44 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:45.622605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:45.623202 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:45.630318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:45.630766 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:45.631556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:45.631993 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:45.665742 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:45.666188 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:45.666635 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lazy-loading 'fault' on Instance uuid 50d21621-3cd9-4755-8588-0e8cb988d280 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:45.711836 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916e287d50864a638d3b1efe692e78e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e3cc2f6e6e4265a268b5f871a7d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:45.723551 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5f6f1557-a98b-48b5-9c2c-f819ad65c788 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 200 len: 1308 microversion: 2.1 time: 0.104597 Dec 13 23:05:45.724134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 244/522] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:45 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:45.772073 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:45.772853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:45.785287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:45.786997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:45.789140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:45.790387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:45.924000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:45.924655 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:45.931616 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:45.932063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:45.932867 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:45.933273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:45.966235 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:45.974888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-103dc19d-9f99-4123-ab99-b28f2a5d1741 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.208999 Dec 13 23:05:45.975479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 279/523] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:45 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:46.069621 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:46.078660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:46.080236 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:46.081907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-48a657c6-5fed-47bd-ad81-2dc285689b73 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.162236 Dec 13 23:05:46.082469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 245/524] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:45 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:46.740923 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:46.741599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] [instance: 50d21621-3cd9-4755-8588-0e8cb988d280] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:46.747534 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:46.747981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:46.748737 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:46.749159 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:46.762828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] HTTP exception thrown: Instance 50d21621-3cd9-4755-8588-0e8cb988d280 could not be found. Dec 13 23:05:46.763425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] Returning 404 to user: Instance 50d21621-3cd9-4755-8588-0e8cb988d280 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:46.764244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7c4b6115-ebd4-4a45-acea-4a65a26ebd89 tempest-AttachVolumeNegativeTest-1705623858 tempest-AttachVolumeNegativeTest-1705623858-project] 10.222.0.13 "GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280" status: 404 len: 111 microversion: 2.1 time: 0.027244 Dec 13 23:05:46.764772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 280/525] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:46 2021] GET /compute/v2.1/servers/50d21621-3cd9-4755-8588-0e8cb988d280 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:05:46.994632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:46.996206 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:47.003056 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:47.003504 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:47.004294 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:47.004751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:47.105326 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:47.105958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:47.112345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:47.112774 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:47.113613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:47.114037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:47.274370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:47.284607 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b6a3a712-0aab-46a4-9fc4-756eba69623c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.295988 Dec 13 23:05:47.285429 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 246/526] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:46 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:47.423410 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:47.448384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:47.451040 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:47.453437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-20d23d57-ae9f-4145-a722-5484e2c854a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.355285 Dec 13 23:05:47.454379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 281/527] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:47 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:48.302389 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:48.303013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:48.312723 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:48.313184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:48.314022 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:48.314451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:48.468351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:48.476114 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:48.476649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:48.483669 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:48.484604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:48.485531 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:48.486112 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:48.486483 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-db8f9153-ab62-406f-ab77-b10415a7040c tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.188097 Dec 13 23:05:48.497842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 247/528] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:48 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:48.632540 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:48.640424 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:48.642225 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:48.643389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bed9c363-c7aa-4474-8099-191ac59fd9dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1742 microversion: 2.20 time: 0.175334 Dec 13 23:05:48.646045 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 282/529] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:48 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:48.836495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-dda3bbdf-fad8-4ecf-9d80-7d77d5402f6b tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Action: 'create', calling method: .version_select at 0x7f039a39ec10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-108906952", "metadata": {"Type": "work"}}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:48.837970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-dda3bbdf-fad8-4ecf-9d80-7d77d5402f6b tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:48.838756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-dda3bbdf-fad8-4ecf-9d80-7d77d5402f6b tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.156090 Dec 13 23:05:48.839283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 248/530] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Dec 13 23:05:48 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:05:48.851838 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e7d58ade-2939-456c-a6d7-59606739dab4 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Action: 'create', calling method: .version_select at 0x7f039aa420d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-984247135", "metadata": {"Type": "work"}}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:48.855862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e7d58ade-2939-456c-a6d7-59606739dab4 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:48.857171 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e7d58ade-2939-456c-a6d7-59606739dab4 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011915 Dec 13 23:05:48.858536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 283/531] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Dec 13 23:05:48 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:05:48.868454 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4827436b-46b4-4943-b4ee-259af13f49ce tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Action: 'create', calling method: .version_select at 0x7f039a36e3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1276794712", "metadata": {"Type": "work"}}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:48.869661 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4827436b-46b4-4943-b4ee-259af13f49ce tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:48.870460 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4827436b-46b4-4943-b4ee-259af13f49ce tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005736 Dec 13 23:05:48.871133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 249/532] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Dec 13 23:05:48 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:05:48.882950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8f5e3072-8cea-430e-ae53-d8a9eeeb25a4 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Calling method '.version_select at 0x7f039ad27700>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:48.912735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-8f5e3072-8cea-430e-ae53-d8a9eeeb25a4 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] HTTP exception thrown: Volume tempest-invalid-1772385294 could not be found. Dec 13 23:05:48.913367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8f5e3072-8cea-430e-ae53-d8a9eeeb25a4 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Returning 404 to user: Volume tempest-invalid-1772385294 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:48.914969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8f5e3072-8cea-430e-ae53-d8a9eeeb25a4 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1772385294" status: 404 len: 99 microversion: 2.1 time: 0.036596 Dec 13 23:05:48.915702 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 284/533] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Dec 13 23:05:48 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1772385294 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 13 23:05:48.925952 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-466e461b-0c86-4d1e-9338-92e12309a448 tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004929 Dec 13 23:05:48.927031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 250/534] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Dec 13 23:05:48 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 13 23:05:48.935555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-963094de-7cde-4ac3-bf6d-ace7e0885cfa tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003518 Dec 13 23:05:48.936044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 285/535] 10.222.0.13 () {58 vars in 1136 bytes} [Mon Dec 13 23:05:48 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 13 23:05:48.945174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ef6aa467-1176-4e8b-892d-172d1e9aaffa tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Calling method '.version_select at 0x7f039a597310>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:48.975706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-ef6aa467-1176-4e8b-892d-172d1e9aaffa tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] HTTP exception thrown: Volume cfe0f89b-a8f7-4115-baf9-b89245a94dbc could not be found. Dec 13 23:05:48.976306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ef6aa467-1176-4e8b-892d-172d1e9aaffa tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Returning 404 to user: Volume cfe0f89b-a8f7-4115-baf9-b89245a94dbc could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:48.977142 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ef6aa467-1176-4e8b-892d-172d1e9aaffa tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/cfe0f89b-a8f7-4115-baf9-b89245a94dbc" status: 404 len: 109 microversion: 2.1 time: 0.035773 Dec 13 23:05:48.977731 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 251/536] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Dec 13 23:05:48 2021] DELETE /compute/v2.1/os-volumes/cfe0f89b-a8f7-4115-baf9-b89245a94dbc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:05:48.986754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-310b3cd6-3be4-48da-91e8-1444021b147d tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Calling method '.version_select at 0x7f039a1b9940>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:49.013201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-310b3cd6-3be4-48da-91e8-1444021b147d tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] HTTP exception thrown: Volume 9f7bd167-55ad-4fa9-b361-70e81d96da8e could not be found. Dec 13 23:05:49.013841 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-310b3cd6-3be4-48da-91e8-1444021b147d tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] Returning 404 to user: Volume 9f7bd167-55ad-4fa9-b361-70e81d96da8e could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:49.014661 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-310b3cd6-3be4-48da-91e8-1444021b147d tempest-VolumesNegativeTest-1535659241 tempest-VolumesNegativeTest-1535659241-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9f7bd167-55ad-4fa9-b361-70e81d96da8e" status: 404 len: 109 microversion: 2.1 time: 0.031680 Dec 13 23:05:49.015350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 286/537] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:05:48 2021] GET /compute/v2.1/os-volumes/9f7bd167-55ad-4fa9-b361-70e81d96da8e => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:05:49.505083 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:49.505683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:49.512561 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:49.513027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:49.513841 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:49.514445 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:49.662195 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:49.662819 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:49.670413 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:49.670944 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:49.672615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:49.673133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:49.736594 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:49.744555 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5a853372-8e0f-4f7d-955c-d7d8938c6149 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.243628 Dec 13 23:05:49.745089 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 252/538] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:49 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:49.857542 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:49.866926 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:49.868738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:49.870100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5c64d778-f975-4d64-af7a-207eeb4ddc24 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1742 microversion: 2.20 time: 0.211740 Dec 13 23:05:49.870695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 287/539] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:49 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1742 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:50.641649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:50.642202 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:50.648722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:50.649266 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:50.650094 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:50.650517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:50.736587 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lazy-loading 'services' on Instance uuid 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:50.763387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:50.764043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:50.771294 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:50.771922 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:50.772732 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:50.773369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:50.814401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-909dd6a1-55ab-4fd8-bea2-495c3567f3a7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a/os-volume_attachments/6193452b-2224-4a75-a5d2-ac2e0390ac56" status: 202 len: 0 microversion: 2.1 time: 0.176822 Dec 13 23:05:50.814975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 253/540] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:05:50 2021] DELETE /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a/os-volume_attachments/6193452b-2224-4a75-a5d2-ac2e0390ac56 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:05:50.890505 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:50.891257 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:50.897645 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:50.898944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:50.899761 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:50.900202 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:50.952741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:50.961509 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ddfe88c9-728b-4d9b-9c8b-c5c51d6433f3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.202785 Dec 13 23:05:50.967405 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 288/541] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:50 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:51.067489 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:51.075943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:51.077985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:51.079187 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-19bf5a94-4859-41e1-80fb-1b0225bc9f0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1742 microversion: 2.20 time: 0.193160 Dec 13 23:05:51.079749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 254/542] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:50 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:05:51.952298 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:51.953994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:51.962632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:51.963139 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:51.964045 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:51.964605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:51.980314 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:51.981652 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:51.991733 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:51.994028 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:51.995064 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:51.996948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:05:51.997629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:52.143461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db125746-2adb-4a2a-9649-e438574d57f5 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 204 len: 0 microversion: 2.1 time: 0.195923 Dec 13 23:05:52.144439 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 289/543] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:05:51 2021] DELETE /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:05:52.152314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:52.153636 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:52.161658 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:52.162248 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:52.163097 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:52.168059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:52.577933 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:52.584853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:52.600573 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8c621d5d-383d-4953-8be2-f5d1cf40d459 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.624973 Dec 13 23:05:52.601154 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 255/544] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:51 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:52.603888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:52.609405 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:52.610141 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:52.611375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:52.615022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-18f7460b-1edc-4649-9739-c5a853c21cb1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.466598 Dec 13 23:05:52.615633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 290/545] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:52 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:52.620349 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:52.620796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:52.621683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:52.624001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:52.790556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:52.800533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4d590104-795d-4711-bb55-ae182516e497 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1515 microversion: 2.1 time: 0.194720 Dec 13 23:05:52.813326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 256/546] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:52 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:53.621082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:53.622291 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:53.634151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:53.635604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:53.635819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:53.637262 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:53.637983 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:53.640685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:53.644623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:53.645535 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:53.646227 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:53.647178 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:53.866845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:53.876696 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:53.888426 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:53.889908 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7994ecb0-a78b-46ee-aacf-2358834dddd0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.258530 Dec 13 23:05:53.893155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 257/547] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:53 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:53.894310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:53.900053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:53.901053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:53.904799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bf940b2e-7f94-445f-a780-c18c7a200ded tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.286736 Dec 13 23:05:53.907196 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 291/548] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:53 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:53.910577 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:53.911251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:53.912259 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:53.912832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:54.096208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:54.105539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1329edc2-ab37-466c-842e-32a58159dccd tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1515 microversion: 2.1 time: 0.210074 Dec 13 23:05:54.106928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 258/549] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:53 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:54.122320 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-39718cff-3e78-42d0-a58d-b7284a25eec2 req-ef397409-a2f7-48ea-a54a-6644887c9805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168526af-2c4e-4e84-8b87-7f2e71d96e16", "name": "network-vif-plugged", "status": "completed", "tag": "ef742767-361d-4046-8bd3-5b8f1c34e632"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:54.125754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:05:54.125754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:05:54.136498 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-39718cff-3e78-42d0-a58d-b7284a25eec2 req-ef397409-a2f7-48ea-a54a-6644887c9805 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:54.137228 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-39718cff-3e78-42d0-a58d-b7284a25eec2 req-ef397409-a2f7-48ea-a54a-6644887c9805 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:54.152025 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-39718cff-3e78-42d0-a58d-b7284a25eec2 req-ef397409-a2f7-48ea-a54a-6644887c9805 service nova] Creating event network-vif-plugged:ef742767-361d-4046-8bd3-5b8f1c34e632 for instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 on hv-cinder-79628 Dec 13 23:05:54.158523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-39718cff-3e78-42d0-a58d-b7284a25eec2 req-ef397409-a2f7-48ea-a54a-6644887c9805 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044397 Dec 13 23:05:54.159705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 292/550] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:05:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:54.811758 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-3d00bb4f-4b80-46d2-ab0a-d0a3165b4423 req-59639a87-1fab-4c84-99f4-20835b02d243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e52bcc7-ca2c-4d3d-b4e9-8343e896825a", "name": "network-vif-deleted", "tag": "1489cd5c-d9ef-4e3b-95b7-b3103b1fe937"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:05:54.814790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:05:54.814790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:05:54.827904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-3d00bb4f-4b80-46d2-ab0a-d0a3165b4423 req-59639a87-1fab-4c84-99f4-20835b02d243 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:54.828921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-3d00bb4f-4b80-46d2-ab0a-d0a3165b4423 req-59639a87-1fab-4c84-99f4-20835b02d243 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:54.840859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-3d00bb4f-4b80-46d2-ab0a-d0a3165b4423 req-59639a87-1fab-4c84-99f4-20835b02d243 service nova] Creating event network-vif-deleted:1489cd5c-d9ef-4e3b-95b7-b3103b1fe937 for instance 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a on hv-cinder-79628 Dec 13 23:05:54.848937 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-3d00bb4f-4b80-46d2-ab0a-d0a3165b4423 req-59639a87-1fab-4c84-99f4-20835b02d243 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041111 Dec 13 23:05:54.850197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 259/551] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:05:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:05:54.911543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:54.912232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:54.921189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:54.921999 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:54.923008 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:54.923705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:54.926740 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:54.927627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:54.944795 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:54.947514 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:54.948533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:54.948968 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:55.133520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:55.149082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:55.150825 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:55.152366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2fbbbf1d-ec33-45dc-a878-150243a097a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.245170 Dec 13 23:05:55.153358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 293/552] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:54 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:55.160340 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:55.161184 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:55.168055 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:55.168795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:55.169800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:55.170385 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:55.214436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:55.215083 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:55.215684 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lazy-loading 'fault' on Instance uuid 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:05:55.232660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:55.255175 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-55e050a2-a8d4-4877-946f-af971b25ffd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.323848 Dec 13 23:05:55.257607 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 260/553] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:54 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:55.312463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:55.321907 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ca1cb0c-8a52-43c2-8381-c2dfd62b69ab tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 200 len: 1309 microversion: 2.1 time: 0.167307 Dec 13 23:05:55.322680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 294/554] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:55 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:56.171798 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:56.173326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:56.180398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:56.181136 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:56.181958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:56.182380 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:56.277177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:56.277877 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:56.292227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:56.292688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:56.295140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:56.295581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:56.437800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:56.451819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:56.457211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:56.460945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-91b73eb8-0bcf-4785-83b0-6b6cc9a38dd1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.291626 Dec 13 23:05:56.464060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 261/555] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:56 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:56.475502 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:56.480363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:56.487003 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:56.487628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:56.488626 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:56.489128 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:56.502923 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:56.507975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] HTTP exception thrown: Instance 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a could not be found. Dec 13 23:05:56.509247 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Returning 404 to user: Instance 5e52bcc7-ca2c-4d3d-b4e9-8343e896825a could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:05:56.510274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c4e759a9-34f4-4230-9533-49292c61b625 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a" status: 404 len: 111 microversion: 2.1 time: 0.043830 Dec 13 23:05:56.510829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 262/556] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:56 2021] GET /compute/v2.1/servers/5e52bcc7-ca2c-4d3d-b4e9-8343e896825a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:05:56.512697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ee1c2503-bd28-44a2-9cec-0818568ba266 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.241890 Dec 13 23:05:56.514079 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 295/557] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:56 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:05:57.480649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:57.481922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:57.489997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:57.490442 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:57.491338 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:57.491764 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:57.533198 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:57.534571 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:57.545400 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:57.548029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:57.549943 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:57.550987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:57.676127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:57.684726 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:57.689839 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:57.691799 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b39dbc3e-d8dd-49ec-a6ae-b30dfe5c02d9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.215096 Dec 13 23:05:57.692444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 263/558] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:57 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:05:57.766642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:57.776452 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7b829aaa-7438-49af-8477-f3d3cd264f5d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.248238 Dec 13 23:05:57.777858 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 296/559] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:57 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:05:58.716581 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:58.719032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:58.728313 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:58.729743 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:58.731374 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:58.733081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:58.795042 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:05:58.795723 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:05:58.807353 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:58.808312 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:58.810714 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:05:58.811409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:05:59.003830 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:59.028676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:59.033512 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:59.035126 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-92373002-6cba-46c4-a2cc-0bb37f130891 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.323704 Dec 13 23:05:59.037690 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 264/560] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:05:58 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:05:59.177468 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:05:59.186369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d9c62aee-4ead-4b84-8e14-18c8089ea687 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.396301 Dec 13 23:05:59.187569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 297/561] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:05:58 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:00.056648 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:00.057241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:00.072757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:00.073558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:00.075057 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:00.075695 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:00.212068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:00.215197 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:00.247589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:00.248844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:00.252117 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:00.253386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:00.281285 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:00.293805 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:00.295766 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:00.297245 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-30357f8c-f32e-48bb-82e8-6e9ecd8455ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.246093 Dec 13 23:06:00.298460 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 265/562] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:00 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:00.422280 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:00.430395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ee8ba7ef-c722-4cc7-8d7b-6d6249aef694 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.230753 Dec 13 23:06:00.430976 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 298/563] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:00 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:00.667807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-957945783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2137429673", "security_groups": [{"name": "tempest-secgroup-smoke-1202888634"}], "networks": [{"uuid": "f74939c0-8214-4417-aae9-b57cd854e0ea"}], "block_device_mapping_v2": [{"uuid": "97378860-2bbb-4d2b-a1d9-a799f0882724", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:00.800974 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] validate_networks() for [('f74939c0-8214-4417-aae9-b57cd854e0ea', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:06:01.318822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:01.320641 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:01.336590 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:01.339334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:01.340924 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:01.343451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:01.404244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:06:01.404715 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:06:01.405531 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:06:01.406593 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:06:01.408632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:06:01.420914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:01.429927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:01.431063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:01.431497 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:01.452707 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Getting quotas for project 5dd4dc022cad44d1baaa51931dfdfa31. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:06:01.458809 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Getting quotas for user 74ed484d62ab45fea26e324f737e231c and project 5dd4dc022cad44d1baaa51931dfdfa31. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:06:01.530258 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:06:01.533458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97378860-2bbb-4d2b-a1d9-a799f0882724',volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:06:01.561631 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:01.570800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:01.575639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:01.583886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-30ece95d-78a6-45c5-baf8-302365d2d8c9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.270550 Dec 13 23:06:01.584802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 299/564] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:01 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:01.589739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:01.592552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:01.607081 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:01.609162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:01.610468 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:01.611551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:01.760898 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-042ee3cb-3a94-4f41-860e-492023c270a4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.097206 Dec 13 23:06:01.762300 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 266/565] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:06:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:06:01.772710 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-96778015-19dd-4a1c-8684-df991921835c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:01.774101 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-96778015-19dd-4a1c-8684-df991921835c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:01.848770 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-96778015-19dd-4a1c-8684-df991921835c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:01.857755 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-96778015-19dd-4a1c-8684-df991921835c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1088 microversion: 2.1 time: 0.088349 Dec 13 23:06:01.860018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 267/566] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:01 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:01.873209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:01.881302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-51df0be1-2e0c-4b5b-b34a-692b001c0ba4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.295079 Dec 13 23:06:01.882300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 300/567] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:01 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:02.605750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:02.607448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:02.617115 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:02.618038 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:02.619077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:02.619702 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:02.879739 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:02.882182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:02.882798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:02.888666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:02.889789 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:02.890232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:02.890775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:02.891026 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:02.891454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:02.892314 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-26bd0c55-41d8-4a25-b48e-ba80d07ab394 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.290242 Dec 13 23:06:02.892980 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 268/568] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:02 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:02.912516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:02.913516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:02.919993 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:02.920444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:02.921326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:02.922134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.009614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:03.026974 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7a1e7bac-ab8e-4f25-a996-cce694bb52ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1186 microversion: 2.1 time: 0.148279 Dec 13 23:06:03.037384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 301/569] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:02 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1186 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:03.128656 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:03.136501 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a9672a60-3cab-4fe9-b3db-2a8296081ac5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1501 microversion: 2.1 time: 0.241111 Dec 13 23:06:03.137079 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 269/570] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:02 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1501 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:03.160019 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f45dd5b-fb46-4ebc-845d-3c28eb14c0da"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:03.161186 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:03.170599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.171606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.172607 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.173194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.203792 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] HTTP exception thrown: Cannot 'attach_volume' instance f930f2d2-ece8-408b-aad2-fcb48bac226d while it is in vm_state rescued Dec 13 23:06:03.204984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Returning 409 to user: Cannot 'attach_volume' instance f930f2d2-ece8-408b-aad2-fcb48bac226d while it is in vm_state rescued {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:06:03.206019 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-77d8ef1f-f58e-459a-9dc3-e9fbfc5cb778 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055465 Dec 13 23:06:03.206925 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 302/571] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:06:03 2021] POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 13 23:06:03.217162 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b951bb53-3c7b-40fe-85c1-e1e08e40d24f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:03.218453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b951bb53-3c7b-40fe-85c1-e1e08e40d24f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:03.226999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b951bb53-3c7b-40fe-85c1-e1e08e40d24f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.228097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b951bb53-3c7b-40fe-85c1-e1e08e40d24f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.228894 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b951bb53-3c7b-40fe-85c1-e1e08e40d24f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.229325 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b951bb53-3c7b-40fe-85c1-e1e08e40d24f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.322590 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b951bb53-3c7b-40fe-85c1-e1e08e40d24f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action" status: 202 len: 0 microversion: 2.1 time: 0.109369 Dec 13 23:06:03.323844 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 270/572] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:06:03 2021] POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:06:03.332830 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:03.333474 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:03.340761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.341364 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.342056 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.342490 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.523187 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:03.531495 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b396cdaa-9356-49d2-81b4-091e5518cb1d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1509 microversion: 2.1 time: 0.203399 Dec 13 23:06:03.532393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 303/573] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:03 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:03.912526 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:03.913889 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:03.920483 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.921265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:03.922249 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:03.922688 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:04.045524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:04.046365 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:04.053710 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:04.054224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:04.055139 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:04.055637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:04.077938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:04.086054 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:04.087847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:04.089008 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-07a19ac1-9b48-4d0e-bf4e-ee1e10291775 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.180474 Dec 13 23:06:04.089696 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 271/574] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:03 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:04.116715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:04.124610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9c3cca85-3992-49d1-9e0d-4e8dac2dc26b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1186 microversion: 2.1 time: 0.082888 Dec 13 23:06:04.125181 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 304/575] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:04 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:04.549277 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:04.549915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:04.556007 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:04.556447 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:04.557229 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:04.557734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:04.692172 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:04.712167 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8c563ab5-1a4c-4f86-8f3b-f68447005d9b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1509 microversion: 2.1 time: 0.166886 Dec 13 23:06:04.713017 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 272/576] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:04 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:05.107519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:05.108897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:05.115425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:05.115945 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:05.117222 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:05.118004 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:05.143255 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:05.144020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:05.152628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:05.153327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:05.154144 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:05.154579 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:05.225726 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:05.233968 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-17cff7c5-5337-4700-947d-58470086a459 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1186 microversion: 2.1 time: 0.096117 Dec 13 23:06:05.234610 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 273/577] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:05 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:05.287939 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:05.295760 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:05.297318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:05.298488 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5c29ba11-d1ac-4aa4-ab5f-9d6044dc98f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1737 microversion: 2.20 time: 0.194717 Dec 13 23:06:05.299047 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 305/578] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:05 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:05.733433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:05.734730 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:05.741985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:05.743666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:05.744485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:05.744922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:05.920018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:05.929230 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-27277195-4650-44ae-a7d7-a8a73cf04d81 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1509 microversion: 2.1 time: 0.200843 Dec 13 23:06:05.930011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 274/579] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:05 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:06.253672 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:06.254288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:06.262516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:06.262956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:06.263751 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:06.264178 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:06.317578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:06.321902 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:06.334286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:06.334614 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:06.335721 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:06.338086 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:06.389194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:06.403904 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-188365a0-4a59-40e4-8e6f-19d237fc6d45 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1204 microversion: 2.1 time: 0.153519 Dec 13 23:06:06.406391 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 306/580] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:06 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1204 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:06.589738 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:06.599856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:06.601420 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:06.602598 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4ff5f7c6-4236-4c03-a391-8e2f4e0f665f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1719 microversion: 2.20 time: 0.288854 Dec 13 23:06:06.603166 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 275/581] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:06 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1719 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:06.755615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-694641797", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "53d3a17f-2e01-4301-affb-58f20cc0584b"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:06.829809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] validate_networks() for [('53d3a17f-2e01-4301-affb-58f20cc0584b', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:06:06.950131 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:06.951000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:06.967094 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:06.967862 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:06.968832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:06.969469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:07.558532 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:07.567347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-fdfd0751-5a80-403a-9933-cebe0d7338b6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1509 microversion: 2.1 time: 0.622617 Dec 13 23:06:07.568017 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 276/582] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:06 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1509 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:07.572806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:07.573646 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:07.579707 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:07.580255 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:07.581371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:07.581859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:07.784785 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:06:07.785258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:06:07.786256 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:06:07.786658 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:06:07.787071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:06:07.797363 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:07.797794 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:07.798611 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:07.799079 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:07.815869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Getting quotas for project a736ec919343435d98e16479a93c4119. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:06:07.820022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Getting quotas for user e442d32351e74eda9e6eb7f01c15f886 and project a736ec919343435d98e16479a93c4119. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:06:07.832664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:06:07.835252 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:06:07.885125 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0c07f8ab-8aa4-4194-ad29-f4b3593419f8 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133218 Dec 13 23:06:07.886216 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 307/583] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:06:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:06:07.891687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:07.892300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:07.898094 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:07.898799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:07.899250 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:07.900045 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:07.900475 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:07.922335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f6303139-6f90-41a5-9df3-ff991ad86311 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.352724 Dec 13 23:06:07.923207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 277/584] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:07 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:07.937707 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ffccca05-3b1d-4c17-bae6-03e16867b937 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:07.938233 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ffccca05-3b1d-4c17-bae6-03e16867b937 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:08.025978 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ffccca05-3b1d-4c17-bae6-03e16867b937 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:08.033783 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ffccca05-3b1d-4c17-bae6-03e16867b937 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1218 microversion: 2.1 time: 0.109286 Dec 13 23:06:08.035575 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 278/585] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:07 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:08.214745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:08.224842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:08.227100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:08.228300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b83fab02-c479-4781-bfd6-583ee15a26db tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1719 microversion: 2.20 time: 0.340922 Dec 13 23:06:08.229769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 308/586] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:07 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1719 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:08.585706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:08.587845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:08.596016 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:08.596592 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:08.597792 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:08.598439 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:08.813720 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-aa3fab1b-06ae-4815-b89a-bf5517b31cb6 req-c977c271-d18d-4363-8568-09a87a71fd4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776bb0b5-5864-48f0-b212-af69708aae04", "tag": "e9a3ffe7-75df-415f-b4cd-1de3c71e604d"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:08.817419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:08.817419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:06:08.826987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-aa3fab1b-06ae-4815-b89a-bf5517b31cb6 req-c977c271-d18d-4363-8568-09a87a71fd4c service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:08.828355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-aa3fab1b-06ae-4815-b89a-bf5517b31cb6 req-c977c271-d18d-4363-8568-09a87a71fd4c service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:08.841995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-aa3fab1b-06ae-4815-b89a-bf5517b31cb6 req-c977c271-d18d-4363-8568-09a87a71fd4c service nova] Creating event network-changed:e9a3ffe7-75df-415f-b4cd-1de3c71e604d for instance 776bb0b5-5864-48f0-b212-af69708aae04 on hv-cinder-79628 Dec 13 23:06:08.848687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-aa3fab1b-06ae-4815-b89a-bf5517b31cb6 req-c977c271-d18d-4363-8568-09a87a71fd4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042614 Dec 13 23:06:08.849857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 309/587] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:08.889500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:08.898776 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bf6980d4-b6bd-4718-869e-c3a94f38b4c9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1515 microversion: 2.1 time: 0.317598 Dec 13 23:06:08.911062 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 279/588] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:08 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1515 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:08.942873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:08.943655 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:08.950755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:08.951208 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:08.953318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:08.953318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:09.052602 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:09.053520 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:09.059904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:09.060344 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:09.061135 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:09.072335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:09.235017 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:09.250482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2ba7f978-aeac-4194-bcae-cf8875123c9b tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1278 microversion: 2.1 time: 0.203459 Dec 13 23:06:09.251976 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 280/589] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:09 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:09.285631 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:09.288472 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:09.300010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:09.300595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:09.303037 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:09.303589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:09.425181 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:09.434520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-81ea8601-c907-42df-8f6a-0342e6e9437b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.498041 Dec 13 23:06:09.441146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 310/590] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:08 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:09.585315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:09.594785 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:09.596414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:09.597841 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9ccd23f4-e670-4068-9249-56f809f843bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1722 microversion: 2.20 time: 0.344641 Dec 13 23:06:09.604183 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 281/591] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:09 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:09.617066 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-57649004-6747-4cb6-8e05-de8cafefec29 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab85fd77-dc22-49c0-baaa-836d567cfeb2"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:09.618138 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-57649004-6747-4cb6-8e05-de8cafefec29 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:09.626671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57649004-6747-4cb6-8e05-de8cafefec29 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:09.627123 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57649004-6747-4cb6-8e05-de8cafefec29 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:09.627927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57649004-6747-4cb6-8e05-de8cafefec29 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:09.628487 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-57649004-6747-4cb6-8e05-de8cafefec29 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:09.986750 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-57649004-6747-4cb6-8e05-de8cafefec29 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.373611 Dec 13 23:06:09.987421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 311/592] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Dec 13 23:06:09 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments => generated 188 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:06:10.067519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-461be280-1ab3-4d6f-bc1b-017617e9942a req-3a2029f2-71e7-4d94-a9b6-0b893c331a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168526af-2c4e-4e84-8b87-7f2e71d96e16", "name": "network-vif-unplugged", "status": "completed", "tag": "ef742767-361d-4046-8bd3-5b8f1c34e632"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:10.069778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:10.069778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:10.082546 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-461be280-1ab3-4d6f-bc1b-017617e9942a req-3a2029f2-71e7-4d94-a9b6-0b893c331a2b service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.083067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-461be280-1ab3-4d6f-bc1b-017617e9942a req-3a2029f2-71e7-4d94-a9b6-0b893c331a2b service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.102179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.compute.server_external_events [req-461be280-1ab3-4d6f-bc1b-017617e9942a req-3a2029f2-71e7-4d94-a9b6-0b893c331a2b service nova] Unable to find a host for instance 168526af-2c4e-4e84-8b87-7f2e71d96e16. Dropping event network-vif-unplugged {{(pid=116225) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 13 23:06:10.103066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-461be280-1ab3-4d6f-bc1b-017617e9942a req-3a2029f2-71e7-4d94-a9b6-0b893c331a2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039360 Dec 13 23:06:10.103657 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 282/593] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 13 23:06:10.127330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d1a618df-f31b-4375-9ef0-8e7306a140bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:10.127889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d1a618df-f31b-4375-9ef0-8e7306a140bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:10.135077 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1a618df-f31b-4375-9ef0-8e7306a140bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.135772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1a618df-f31b-4375-9ef0-8e7306a140bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.137141 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1a618df-f31b-4375-9ef0-8e7306a140bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.137839 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1a618df-f31b-4375-9ef0-8e7306a140bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.239522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d1a618df-f31b-4375-9ef0-8e7306a140bb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action" status: 202 len: 0 microversion: 2.20 time: 0.116061 Dec 13 23:06:10.240722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 312/594] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:06:10 2021] POST /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:06:10.248574 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:10.249496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:10.257291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.257969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.258917 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.259500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.270190 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:10.271738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:10.288797 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.289580 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.290550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.291135 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.514268 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:10.519139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:10.525130 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4c594b39-cf93-4f6c-a169-e25c21c0c63e tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1318 microversion: 2.1 time: 0.258606 Dec 13 23:06:10.525947 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 313/595] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:10 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:10.533163 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:10.533805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:10.537024 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:10.539138 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:10.540760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0f9620b7-f2bb-4d55-8750-0dad3b4fbb15 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1748 microversion: 2.20 time: 0.295923 Dec 13 23:06:10.544389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.545061 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.546584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.547372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.553297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 283/596] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:10 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1748 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:10.559126 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:10.559882 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:10.568538 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.569215 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.570223 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.570797 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.811265 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:10.813967 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:10.821379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d9e45e83-94b6-4996-b921-623c5ab50608 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1515 microversion: 2.1 time: 0.294144 Dec 13 23:06:10.822210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 314/597] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:10 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:10.823527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4f623cc7-6e37-41da-aa00-7010c818ab32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.268611 Dec 13 23:06:10.824105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 284/598] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:10 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:10.839861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-539fa806-02cb-4dce-ae1d-3c9932f196d3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bd97556-1435-4265-a13b-8a02502a4e9b"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:10.841259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-539fa806-02cb-4dce-ae1d-3c9932f196d3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:10.847633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-539fa806-02cb-4dce-ae1d-3c9932f196d3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.848158 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-539fa806-02cb-4dce-ae1d-3c9932f196d3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.849003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-539fa806-02cb-4dce-ae1d-3c9932f196d3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.849679 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-539fa806-02cb-4dce-ae1d-3c9932f196d3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.920627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-79937849-07d1-454b-a3b2-2c85c6f934eb req-f4380bf0-d666-45b7-b31d-c49a6ea9b553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af221e52-2be9-41ab-b621-9a4596812cb3", "tag": "28096ea4-0a35-41bd-92d2-396aa7f752cd"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:10.923292 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:10.923292 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:10.937525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-79937849-07d1-454b-a3b2-2c85c6f934eb req-f4380bf0-d666-45b7-b31d-c49a6ea9b553 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:10.938148 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-79937849-07d1-454b-a3b2-2c85c6f934eb req-f4380bf0-d666-45b7-b31d-c49a6ea9b553 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:10.961492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-79937849-07d1-454b-a3b2-2c85c6f934eb req-f4380bf0-d666-45b7-b31d-c49a6ea9b553 service nova] Creating event network-changed:28096ea4-0a35-41bd-92d2-396aa7f752cd for instance af221e52-2be9-41ab-b621-9a4596812cb3 on hv-cinder-79628 Dec 13 23:06:10.966409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-79937849-07d1-454b-a3b2-2c85c6f934eb req-f4380bf0-d666-45b7-b31d-c49a6ea9b553 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050586 Dec 13 23:06:10.967013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 285/599] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:06:11.199343 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-539fa806-02cb-4dce-ae1d-3c9932f196d3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364220 Dec 13 23:06:11.200507 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 315/600] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:06:10 2021] POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:11.542634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:11.543614 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:11.551492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:11.552075 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:11.552901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:11.553536 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:11.561484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:11.562583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:11.583201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:11.584049 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:11.585066 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:11.585596 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:11.829484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:11.836194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:11.839816 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1e0d2524-a499-44de-87b3-9dc51ef35366 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1318 microversion: 2.1 time: 0.301115 Dec 13 23:06:11.840406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 286/601] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:11 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:11.846190 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:11.846514 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:11.847657 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:11.848425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:11.850111 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-eee1e4c0-3fee-4e92-b05e-2710775fc36d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1750 microversion: 2.20 time: 0.293351 Dec 13 23:06:11.851116 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 316/602] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:11 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1750 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:11.854211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:11.854656 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:11.855611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:11.856058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:12.042341 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:12.051492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4c39f6d1-7c94-451a-95d6-32fc58ef0bce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.209265 Dec 13 23:06:12.052491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 287/603] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:11 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:12.855767 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:12.856380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:12.863050 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:12.863508 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:12.864354 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:12.864712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:12.868990 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:12.870077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:12.876880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:12.877315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:12.878760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:12.879197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:13.070722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:13.078915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:13.081199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8565c20f-daf4-4d49-8e06-1f6897af1b34 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1318 microversion: 2.1 time: 0.229045 Dec 13 23:06:13.091119 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 317/604] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:12 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:13.091613 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:13.094129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:13.096070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bbc09a3b-5755-4796-8a08-740c06f8d5e1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1750 microversion: 2.20 time: 0.230438 Dec 13 23:06:13.097087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:13.097640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 288/605] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:12 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:13.107936 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:13.114512 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:13.114976 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:13.115888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:13.116350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:13.308468 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:13.316839 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3a8886bf-7707-44fa-acb3-b7d322efcba8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.224476 Dec 13 23:06:13.317457 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 318/606] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:13 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:14.099211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:14.100087 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:14.107504 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:14.107827 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:14.108972 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:14.109494 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:14.115764 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:14.116380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:14.125010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:14.126659 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:14.127996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:14.128696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:14.336310 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:14.341195 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:14.347344 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-54db00e1-aa67-4ffe-8e9c-b62118c6a33c tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1318 microversion: 2.1 time: 0.252644 Dec 13 23:06:14.348171 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 289/607] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:14 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:14.352634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:14.352849 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:14.353242 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:14.354548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:14.355870 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-aaa12caf-d1dc-4a46-ace7-26a0b404a1fd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1750 microversion: 2.20 time: 0.244271 Dec 13 23:06:14.356400 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 319/608] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:14 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1750 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:14.359852 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:14.360293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:14.361090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:14.361550 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:14.495244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:14.503214 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-054d0aea-260c-4081-b275-d862863110b9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.153807 Dec 13 23:06:14.503781 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 290/609] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:14 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:15.364440 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:15.365025 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:15.372851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:15.373232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:15.374317 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:15.374753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:15.375593 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:15.376170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:15.382453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:15.383117 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:15.384511 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:15.384951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:15.575099 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:15.578460 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:15.583062 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-de7c0251-62e3-4521-9a95-53b92035f4a9 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1318 microversion: 2.1 time: 0.222404 Dec 13 23:06:15.583701 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 320/610] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:15 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:15.587241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:15.588816 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:15.588964 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-691925471", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "f2c49a7f-3da1-49ae-852a-b4db2605a7cd"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:15.590166 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a44e0cdb-c01b-4d7f-a8a5-cc6f7dc5666d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1750 microversion: 2.20 time: 0.219463 Dec 13 23:06:15.593164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 291/611] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:15 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:15.596510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:15.597111 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:15.603202 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:15.603661 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:15.604438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:15.604864 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:15.646808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] validate_networks() for [('f2c49a7f-3da1-49ae-852a-b4db2605a7cd', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:06:15.833030 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:15.840858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-925d1f5a-36b7-42de-aea9-62a8e25fbd8c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.249113 Dec 13 23:06:15.841428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 292/612] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:15 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:16.059003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:06:16.059556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:06:16.060107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:06:16.060513 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:06:16.060921 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:06:16.069720 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.070164 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.070962 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.071380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.087689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Getting quotas for project 29aac56f8b7648db9654aeb5eb465d73. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:06:16.091569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Getting quotas for user 666cd56f5dba4ecba144c1be64791843 and project 29aac56f8b7648db9654aeb5eb465d73. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:06:16.102360 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:06:16.104782 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:06:16.110177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-83fda1c9-886f-456c-bfab-3e84a8248a32 req-2c5a550e-3154-49b2-986c-f13f093ed6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af221e52-2be9-41ab-b621-9a4596812cb3", "name": "network-vif-plugged", "status": "completed", "tag": "28096ea4-0a35-41bd-92d2-396aa7f752cd"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:16.111791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:16.111791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:16.119155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-83fda1c9-886f-456c-bfab-3e84a8248a32 req-2c5a550e-3154-49b2-986c-f13f093ed6c2 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.119587 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-83fda1c9-886f-456c-bfab-3e84a8248a32 req-2c5a550e-3154-49b2-986c-f13f093ed6c2 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.131403 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-83fda1c9-886f-456c-bfab-3e84a8248a32 req-2c5a550e-3154-49b2-986c-f13f093ed6c2 service nova] Creating event network-vif-plugged:28096ea4-0a35-41bd-92d2-396aa7f752cd for instance af221e52-2be9-41ab-b621-9a4596812cb3 on hv-cinder-79628 Dec 13 23:06:16.136700 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-83fda1c9-886f-456c-bfab-3e84a8248a32 req-2c5a550e-3154-49b2-986c-f13f093ed6c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030933 Dec 13 23:06:16.137563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 293/613] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:06:16.149232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7a49c30e-fbfc-43af-9e7f-f685b656a67f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564409 Dec 13 23:06:16.150194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 321/614] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:06:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:06:16.182116 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c8c99c3f-9559-4d3b-8e0f-ccf27a002818 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:16.183415 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c8c99c3f-9559-4d3b-8e0f-ccf27a002818 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:16.239002 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c8c99c3f-9559-4d3b-8e0f-ccf27a002818 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:16.246517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c8c99c3f-9559-4d3b-8e0f-ccf27a002818 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1213 microversion: 2.1 time: 0.085673 Dec 13 23:06:16.249296 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 294/615] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:16 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:16.600522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:16.601106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:16.607748 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.607921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:16.608474 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.608640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:16.609382 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.609855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.616788 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.617278 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.618057 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.618662 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.811699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:16.815200 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:16.823702 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3cc4bada-bc82-4d2d-b8e8-1790aa9babf7 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1318 microversion: 2.1 time: 0.226960 Dec 13 23:06:16.824807 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 322/616] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:16 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:16.826958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:16.828559 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:16.830095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b31792c3-adc6-41da-8b86-4b71e6748cdf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1750 microversion: 2.20 time: 0.226097 Dec 13 23:06:16.830631 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 295/617] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:16 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1750 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:16.857779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:16.858333 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:16.864987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.865490 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:16.866282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:16.866716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:17.018766 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:17.030182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-affebf74-c18e-46bf-b3f6-6d6c3744be3f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.175825 Dec 13 23:06:17.031032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 323/618] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:16 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:17.265008 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:17.265569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:17.271966 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:17.272414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:17.273187 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:17.273681 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:17.337905 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:17.347615 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e255a601-69c2-4a68-922a-06ce5ade12e3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1265 microversion: 2.1 time: 0.086967 Dec 13 23:06:17.348385 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 296/619] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:17 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:17.841829 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:17.844788 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:17.847983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:17.849194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:17.852057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:17.852611 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:17.854660 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:17.855205 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:17.856438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:17.857072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:17.857899 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:17.858322 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.069149 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:18.076387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c0b6b8a8-3df8-4109-9cb6-32fac79d93d2 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1318 microversion: 2.1 time: 0.238462 Dec 13 23:06:18.078198 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 324/620] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:17 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:18.090732 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:18.096584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:18.103641 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.104088 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.105015 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.105598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.153880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:18.163611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:18.169164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:18.172303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4a3454e8-002d-4972-9940-0f8785343e88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1750 microversion: 2.20 time: 0.327361 Dec 13 23:06:18.188675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 297/621] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:17 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1750 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:18.277566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:18.285653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0bffbb96-cda7-46ff-a61c-4250d740b2ab tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.203973 Dec 13 23:06:18.286900 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 325/622] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:18 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:18.364525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:18.365036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:18.371127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.371573 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.372362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.372973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.514713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:18.522253 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-45708132-4d6b-4ac0-8c19-6466b5dd3fcf tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.161833 Dec 13 23:06:18.522903 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 298/623] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:18 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:18.750565 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:18.752157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:18.758182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.758846 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.759662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.760087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.790498 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lazy-loading 'flavor' on Instance uuid f930f2d2-ece8-408b-aad2-fcb48bac226d {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:06:18.857887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-baea8ab9-804d-4fb8-b4ac-f5436e9ab9f7 req-f87b5551-ec54-42d5-8d2d-8408f16c9ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6c7572-b807-4c04-9d8d-e407ff94016d", "tag": "d032ffaf-1a34-4a11-a6a7-8199e3ce1ea0"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:18.861699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:18.861699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:18.877108 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-baea8ab9-804d-4fb8-b4ac-f5436e9ab9f7 req-f87b5551-ec54-42d5-8d2d-8408f16c9ed0 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.879540 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-baea8ab9-804d-4fb8-b4ac-f5436e9ab9f7 req-f87b5551-ec54-42d5-8d2d-8408f16c9ed0 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.895237 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-baea8ab9-804d-4fb8-b4ac-f5436e9ab9f7 req-f87b5551-ec54-42d5-8d2d-8408f16c9ed0 service nova] Creating event network-changed:d032ffaf-1a34-4a11-a6a7-8199e3ce1ea0 for instance 1c6c7572-b807-4c04-9d8d-e407ff94016d on hv-cinder-79628 Dec 13 23:06:18.901114 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-baea8ab9-804d-4fb8-b4ac-f5436e9ab9f7 req-f87b5551-ec54-42d5-8d2d-8408f16c9ed0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047547 Dec 13 23:06:18.916089 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 299/624] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:06:18.964169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-416237d6-530c-4e43-9f84-88b8aa6e9e88 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action" status: 200 len: 32 microversion: 2.1 time: 0.216559 Dec 13 23:06:18.964893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 326/625] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:06:18 2021] POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:06:18.975018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:18.976388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:18.983594 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.990118 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:18.991077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:18.991520 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:19.095598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:19.096299 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:19.103319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:19.103766 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:19.104622 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:19.105146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:19.537614 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:19.549161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f7f16fee-6ad1-4ead-8811-ac32a426129d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.578443 Dec 13 23:06:19.560440 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 300/626] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:18 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:19.565559 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:19.566266 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:19.574901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:19.575486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:19.576349 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:19.577263 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:19.582895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:19.591063 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b2e65386-080d-4ed5-a149-71402b5cc3bb tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1507 microversion: 2.1 time: 0.499740 Dec 13 23:06:19.601747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 327/627] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:19 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1507 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:19.608397 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:19.609490 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:19.615820 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:19.616262 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:19.617060 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:19.617512 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.056048 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:20.068105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:20.070086 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:20.071497 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4cad09b6-e8e3-4ece-bc5a-d7bb2f431160 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.520432 Dec 13 23:06:20.072575 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 301/628] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:19 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:20.077121 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:20.078005 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:20.081389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:20.086221 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:20.087650 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.089576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:20.093271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.100027 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-724b89cf-b7fd-4902-945a-baf195674538 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.495326 Dec 13 23:06:20.100628 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 328/629] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:19 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:20.105469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c25f61cc-6f0a-4a6f-9716-35838ce2a605 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72ba09dc-ab71-40a4-aaff-3d0fd59b8345", "device": "/dev/sdb"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:20.106806 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c25f61cc-6f0a-4a6f-9716-35838ce2a605 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:20.113446 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c25f61cc-6f0a-4a6f-9716-35838ce2a605 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:20.114063 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c25f61cc-6f0a-4a6f-9716-35838ce2a605 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.115039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c25f61cc-6f0a-4a6f-9716-35838ce2a605 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:20.115628 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c25f61cc-6f0a-4a6f-9716-35838ce2a605 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.431274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c25f61cc-6f0a-4a6f-9716-35838ce2a605 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "POST /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329177 Dec 13 23:06:20.432142 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 329/630] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:06:20 2021] POST /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:20.438782 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-848d28f5-3a2b-405f-bbab-1df0a4883e4d req-40f37327-e22d-4e7c-857e-88c9751fed32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776bb0b5-5864-48f0-b212-af69708aae04", "name": "network-vif-plugged", "status": "completed", "tag": "e9a3ffe7-75df-415f-b4cd-1de3c71e604d"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:20.438973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:20.441282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:20.441282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:06:20.449741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-848d28f5-3a2b-405f-bbab-1df0a4883e4d req-40f37327-e22d-4e7c-857e-88c9751fed32 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:20.452579 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b0921dc2-0f00-4c34-b3e6-ef685cab90ee tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.378729 Dec 13 23:06:20.454444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 302/631] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:20 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:20.458040 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-848d28f5-3a2b-405f-bbab-1df0a4883e4d req-40f37327-e22d-4e7c-857e-88c9751fed32 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.484608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-848d28f5-3a2b-405f-bbab-1df0a4883e4d req-40f37327-e22d-4e7c-857e-88c9751fed32 service nova] Creating event network-vif-plugged:e9a3ffe7-75df-415f-b4cd-1de3c71e604d for instance 776bb0b5-5864-48f0-b212-af69708aae04 on hv-cinder-79628 Dec 13 23:06:20.498581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-848d28f5-3a2b-405f-bbab-1df0a4883e4d req-40f37327-e22d-4e7c-857e-88c9751fed32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056766 Dec 13 23:06:20.498581 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 330/632] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:20.517900 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:06:20.518072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: Mon Dec 13 23:06:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:06:20.568379 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:20.569119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:20.575068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:20.575508 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.576274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:20.576995 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:20.742137 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:20.750443 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1e9fde14-4cee-457f-8501-cfcbbc81c650 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.185740 Dec 13 23:06:20.751105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 303/633] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:20 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:21.091266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:21.091956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:21.098225 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.098663 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.099433 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.099888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.121464 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:21.122708 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:21.138291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.138988 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.140553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.141006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.340880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:21.351152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:21.352668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:21.353963 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8fcd837c-561f-4991-aae3-eed4d2aefe07 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.267269 Dec 13 23:06:21.354560 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 331/634] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:21 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:21.364565 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:21.365424 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:21.367011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:21.376601 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-12ab373b-a5b2-42f2-b5dd-6af6dde84117 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.258810 Dec 13 23:06:21.377176 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 304/635] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:21 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:21.378651 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.379582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.380388 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.381000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.469757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lazy-loading 'services' on Instance uuid ff8b680f-031a-4c92-b62f-cf4069ffec8f {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:06:21.472289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:21.473009 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:21.478943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.479675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.480670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.481324 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.555856 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c2daa623-f572-404e-a7fa-729f2b719500 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-volume_attachments/cc926fc5-6ad0-44bd-a526-2d789c182d65" status: 202 len: 0 microversion: 2.1 time: 0.200050 Dec 13 23:06:21.556541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 332/636] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:06:21 2021] DELETE /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-volume_attachments/cc926fc5-6ad0-44bd-a526-2d789c182d65 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:06:21.652777 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:21.670101 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3e665c18-63c2-4075-86c9-a2e35f66b04c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.202761 Dec 13 23:06:21.674251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 305/637] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:21 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:21.769955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:21.771065 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:21.778436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.779239 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.780264 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:21.780618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:21.944990 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:21.955746 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-563ac3ae-3d4e-47d2-9d6c-d086baf00e96 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.190445 Dec 13 23:06:21.956200 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 333/638] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:21 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:22.372116 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:22.372724 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:22.386004 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.388032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:22.389246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.389756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:22.394319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:22.395802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:22.406822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.407290 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:22.408090 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.408702 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:22.621860 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:22.630601 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:22.637097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:22.638661 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a9c8014c-2ae4-4f50-8555-a431765f39ad tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.270392 Dec 13 23:06:22.651042 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 306/639] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:22 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:22.661255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:22.669325 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9caa7bbe-87d9-4bed-8f49-00234fa16547 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.279804 Dec 13 23:06:22.670308 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 334/640] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:22 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:22.688043 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:22.688818 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:22.696973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.697598 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:22.699128 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.699832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:22.873911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:22.881936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-fd3d901d-57d0-4aa7-a119-e4aaa6d006db tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.197833 Dec 13 23:06:22.891770 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 307/641] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:22 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:22.972210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:22.972781 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:22.979640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.980109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:22.980918 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:22.981381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:23.129552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:23.141851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-32e09d05-c3bd-441a-bb47-349acd59db2f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.173312 Dec 13 23:06:23.142444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 335/642] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:22 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:23.657023 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:23.657621 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:23.663910 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:23.664322 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:23.665148 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:23.665609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:23.686660 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:23.688400 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:23.694570 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:23.695246 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:23.696217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:23.696793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:23.889689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:23.898663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:23.898845 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:23.900309 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:23.901595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7f07a8f3-39a7-4b04-b5a0-1616ba304627 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.248743 Dec 13 23:06:23.902199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 308/643] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:23 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:23.906593 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:23.906929 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-789a611d-c252-4988-9abc-7379c76f0b3b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.223855 Dec 13 23:06:23.907380 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:23.909622 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 336/644] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:23 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:23.913121 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:23.913806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:23.914591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:23.915024 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:24.063525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:24.073283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6389d6ad-39cf-4549-b554-9984a55fbdc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.169978 Dec 13 23:06:24.082967 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 309/645] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:23 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:24.160544 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:24.161326 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:24.169223 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:24.169777 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:24.170749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:24.171257 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:24.186158 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-9d0d8d2d-abe8-4227-a162-313668f0d841 req-4194e42d-d236-4533-9f20-180202fb25c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6c7572-b807-4c04-9d8d-e407ff94016d", "name": "network-vif-plugged", "status": "completed", "tag": "d032ffaf-1a34-4a11-a6a7-8199e3ce1ea0"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:24.188141 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:24.188141 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:24.207853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-9d0d8d2d-abe8-4227-a162-313668f0d841 req-4194e42d-d236-4533-9f20-180202fb25c5 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:24.208315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-9d0d8d2d-abe8-4227-a162-313668f0d841 req-4194e42d-d236-4533-9f20-180202fb25c5 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:24.219892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-9d0d8d2d-abe8-4227-a162-313668f0d841 req-4194e42d-d236-4533-9f20-180202fb25c5 service nova] Creating event network-vif-plugged:d032ffaf-1a34-4a11-a6a7-8199e3ce1ea0 for instance 1c6c7572-b807-4c04-9d8d-e407ff94016d on hv-cinder-79628 Dec 13 23:06:24.225269 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-9d0d8d2d-abe8-4227-a162-313668f0d841 req-4194e42d-d236-4533-9f20-180202fb25c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043939 Dec 13 23:06:24.225997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 310/646] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:06:24.334773 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:24.343976 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-32cedeec-66c3-4b39-aff7-900ab567d27b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.188506 Dec 13 23:06:24.347302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 337/647] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:24 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:24.922311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:24.923000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:24.923240 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:24.923843 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:24.930213 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:24.930437 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:24.930636 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:24.930842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:24.931406 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:24.931619 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:24.931830 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:24.932061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:25.145740 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:25.149081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:25.161198 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8d8cb376-4b5e-4f89-a508-6879b2fa8206 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.241559 Dec 13 23:06:25.161784 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 338/648] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:24 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:25.166034 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:25.166639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:25.174511 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:25.175554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:25.176541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:25.176750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:25.177349 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:25.177949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:25.178077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e12af24f-d64e-4b47-b5bf-1f36e3c82e7e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.260047 Dec 13 23:06:25.178520 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 311/649] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:24 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:25.318212 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:25.325484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2e8d60a0-3568-419d-b860-ec22a525809c tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.162735 Dec 13 23:06:25.326041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 339/650] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:25 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:25.361986 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:25.362602 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:25.368932 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:25.369406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:25.370199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:25.370815 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:25.523027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:25.531157 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e954d029-553b-4882-8495-10a2f38db849 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.173614 Dec 13 23:06:25.540904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 312/651] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:25 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:26.178668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:26.179289 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:26.185821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.186278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.187116 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.187926 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.195818 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:26.196413 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:26.202862 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.203481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.204459 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.204881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.400368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:26.407477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:26.415111 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:26.415960 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c1c99cf9-1f5b-4be4-acd7-90f20ceb3b8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.241295 Dec 13 23:06:26.416741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 340/652] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:26 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:26.417018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:26.420994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:26.421678 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:26.425184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f4cde89e-1b38-4a9d-a083-dfb63040f72a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.232977 Dec 13 23:06:26.425927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 313/653] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:26 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:26.428819 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.429207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.433016 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.434125 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.548225 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:26.548836 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:26.555611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.556064 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.556853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:26.557283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:26.570866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:26.579543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b9271693-117d-463e-9bc0-ada77b1f0719 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.161887 Dec 13 23:06:26.589637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 341/654] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:26 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:26.700065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:26.708644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-aa3465db-9de4-4721-b407-4f6d06633cc6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.164147 Dec 13 23:06:26.709211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 314/655] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:26 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:27.432580 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:27.433297 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:27.439851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.440372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.441160 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.441625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.445021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:27.445667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:27.452761 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.453362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.454154 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.454577 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.654639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:27.657670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:27.663275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-15e2be7c-f7fa-4d76-a14a-f94769a20f5d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.234371 Dec 13 23:06:27.670373 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 342/656] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:27 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:27.673583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:27.674281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:27.675136 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:27.677006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:27.678210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-af86db43-8e88-4871-8e06-e1acec888ffd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.236957 Dec 13 23:06:27.679118 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 315/657] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:27 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:27.681077 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.681582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.682371 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.682847 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.730730 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:27.731760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:27.738901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.739691 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.740975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:27.741872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:27.864351 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:27.878765 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-31f681c8-8d91-4345-a96e-0371f1576daa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.213841 Dec 13 23:06:27.879549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 343/658] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:27 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:27.918633 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:27.927254 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8c84782d-5984-47e7-8c60-6bf29f62f40b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.203201 Dec 13 23:06:27.927890 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 316/659] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:27 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:28.681832 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:28.682562 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:28.689915 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.690269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:28.691068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.696642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:28.697314 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:28.702314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:28.707764 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.708211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:28.709010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.709468 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:28.919926 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:28.922549 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:28.929425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a4c0f5fe-d1f4-471f-b411-e5f252e48b07 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.251195 Dec 13 23:06:28.941491 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 344/660] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:28 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:28.943168 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:28.943258 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:28.943369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:28.957925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:28.957925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5d1c0d9b-0ec4-409b-ab28-f264cb11c650 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.252774 Dec 13 23:06:28.958261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.958261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:28.958261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.958261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:28.958568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 317/661] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:28 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:28.958568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:28.958723 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:28.965287 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.965837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:28.966642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:28.967177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:29.197486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:29.200465 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:29.206123 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b91182f1-e429-4a38-8b9f-3b607ea1eb4b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.253005 Dec 13 23:06:29.206810 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 318/662] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:28 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:29.207675 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6d8f1c15-0eb2-420f-a14f-ae57a0b7069f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.275936 Dec 13 23:06:29.208261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 345/663] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:28 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:29.948513 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:29.949517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:29.958230 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:29.958659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:29.960847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:29.961485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:29.966849 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:29.967765 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:29.974851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:29.975307 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:29.976096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:29.976530 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:30.180152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:30.189667 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:30.190660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:30.191155 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:30.192317 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-67cd4003-cda9-4eb0-9a1a-024cac6b9d99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.230372 Dec 13 23:06:30.193389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 346/664] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:29 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:30.208266 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2f757a1c-39eb-441d-94a9-89e350b9abe9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.263918 Dec 13 23:06:30.208843 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 319/665] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:29 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:30.224769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:30.225739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:30.226081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:30.226778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:30.232734 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:30.232971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:30.233181 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:30.233441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:30.233992 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:30.234261 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:30.234420 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:30.234720 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:30.440735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:30.448271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e72650c4-48fb-4002-aa6a-a454e2304f9f tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.226731 Dec 13 23:06:30.455059 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 320/666] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:30 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:30.456218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:30.464260 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-53ca21dd-6bc1-4f6b-b7dc-cd7889977dc1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.243134 Dec 13 23:06:30.464795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 347/667] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:30 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:31.210887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:31.211479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:31.218043 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.218487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.219275 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.220418 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.224998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:31.225625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:31.231889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.232329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.233096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.233625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.426754 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:31.435732 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:31.437428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:31.438803 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-12f2b92e-6358-45b4-8a8c-263726710197 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.231622 Dec 13 23:06:31.439699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 321/668] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:31 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:31.444288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:31.462912 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-28df72d9-34e6-47ab-8fb3-ec0e3758cfd9 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.241398 Dec 13 23:06:31.469883 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 348/669] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:31 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:31.470067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:31.470067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:31.478010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.478539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.479396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.479898 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.481627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:31.482238 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:31.488425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.488874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.489683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:31.490115 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:31.687545 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:31.690706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:31.698991 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6d126a63-1f22-4a71-8dbf-4fd497923d34 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.237026 Dec 13 23:06:31.699895 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 322/670] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:31 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:31.701608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bb9218b0-f55a-4533-b5b3-3b6197cd1cd1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.223392 Dec 13 23:06:31.702351 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 349/671] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:31 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:32.458829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:32.459442 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:32.466184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.466568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:32.467339 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.467766 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:32.482249 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:32.482875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:32.489976 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.490450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:32.491509 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.492020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:32.708858 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:32.719385 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d5918d5c-c6cc-4871-a9b5-169e71c1a8d6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1260 microversion: 2.1 time: 0.242529 Dec 13 23:06:32.720291 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 350/672] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:32 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:32.724868 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:32.725504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:32.731604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.732046 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:32.732181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:32.732838 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.733267 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:32.741194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:32.742914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:32.744164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4f300f2d-0189-45cd-9cda-17462c0a8357 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.289250 Dec 13 23:06:32.744841 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 323/673] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:32 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:32.752033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:32.752033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:32.757092 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.757632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:32.758512 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:32.758995 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:33.184990 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:33.189936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:33.192785 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-71fbfc21-4357-4d00-9d58-0b0764ff0b87 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.471489 Dec 13 23:06:33.202569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 351/674] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:32 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:33.202869 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-66666706-089a-4332-be9e-bcccd8c2bb3d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.452091 Dec 13 23:06:33.202869 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 324/675] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:32 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:33.738064 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:33.738670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:33.745508 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:33.745958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:33.746727 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:33.747229 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:33.762937 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:33.763518 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:33.771077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:33.771524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:33.772282 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:33.772740 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:33.946082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:33.951188 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:33.954013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d1b6ef0c-8937-4e08-a499-fc1744f5b47e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1445 microversion: 2.1 time: 0.220636 Dec 13 23:06:33.954812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 352/676] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:33 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1445 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:33.965985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:33.967502 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:33.968651 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cf3c417e-4015-4ebd-9f42-9511c2ea908a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.209500 Dec 13 23:06:33.969218 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 325/677] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:33 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:33.970074 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:33.970678 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:33.977350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:33.977837 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:33.978608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:33.979032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:34.120746 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:34.130882 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-09c99a02-cf84-4e31-8c60-1316710cfe95 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1445 microversion: 2.1 time: 0.164364 Dec 13 23:06:34.131479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 353/678] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:33 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:34.210698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:34.211503 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:34.214873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:34.215681 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:34.222899 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:34.223379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:34.224169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:34.224743 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:34.234057 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:34.234823 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:34.235952 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:34.236626 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:34.448496 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:34.461289 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dbe94bb5-79fe-4ea3-b742-91ef176be6a1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.250085 Dec 13 23:06:34.471287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 354/679] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:34 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:34.484214 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:34.493646 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-219fef6d-3776-4836-95ff-b43e7d66b04e tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1313 microversion: 2.1 time: 0.286602 Dec 13 23:06:34.494455 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 326/680] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:34 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:34.987600 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:34.988290 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:34.994755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:34.995210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:34.995989 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:34.996417 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:35.129577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:35.137910 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:35.139386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:35.140505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-54b0dd34-8180-4ff5-b699-308fc168a236 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.157030 Dec 13 23:06:35.141103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 355/681] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:34 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:35.478880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:35.479529 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:35.487086 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:35.487809 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:35.488589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:35.489011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:35.511993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:35.512821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:35.519021 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:35.519568 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:35.520433 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:35.521190 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:35.681409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:35.689569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cad39374-cd4e-48c5-b64b-c3369dfd21ef tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.214293 Dec 13 23:06:35.690278 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 327/682] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:35 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:35.704841 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:35.712429 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c05ac696-5ecf-49f5-a241-cc94f474d176 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1498 microversion: 2.1 time: 0.204400 Dec 13 23:06:35.713002 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 356/683] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:35 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:35.994796 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-39908e7e-4676-4425-8561-533f08f5e60d req-0c817575-b823-4bf8-ac2c-ba4d0b5bf370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776bb0b5-5864-48f0-b212-af69708aae04", "tag": "e9a3ffe7-75df-415f-b4cd-1de3c71e604d"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:35.995335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:35.995335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:36.002353 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-39908e7e-4676-4425-8561-533f08f5e60d req-0c817575-b823-4bf8-ac2c-ba4d0b5bf370 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.002672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-39908e7e-4676-4425-8561-533f08f5e60d req-0c817575-b823-4bf8-ac2c-ba4d0b5bf370 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.016022 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-39908e7e-4676-4425-8561-533f08f5e60d req-0c817575-b823-4bf8-ac2c-ba4d0b5bf370 service nova] Creating event network-changed:e9a3ffe7-75df-415f-b4cd-1de3c71e604d for instance 776bb0b5-5864-48f0-b212-af69708aae04 on hv-cinder-79628 Dec 13 23:06:36.025831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-39908e7e-4676-4425-8561-533f08f5e60d req-0c817575-b823-4bf8-ac2c-ba4d0b5bf370 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036416 Dec 13 23:06:36.026713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 328/684] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:36.160589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:36.161451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:36.167889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.168358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.170189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.170711 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.244525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:36.245355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:36.252184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.252773 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.253595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.254021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.278848 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:06:36.376635 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1ed85ed2-2e2c-4c5a-9643-e1f7d119eb67 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 204 len: 0 microversion: 2.1 time: 0.135392 Dec 13 23:06:36.378718 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 329/685] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:06:36 2021] DELETE /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 13 23:06:36.407175 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:36.407891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:36.423526 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.424332 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.425789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.426712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.436634 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:36.448753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:36.450852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:36.452227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-26257e3c-114a-4ba6-9ec2-95802d924a16 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.296293 Dec 13 23:06:36.462007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 357/686] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:36 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:36.650216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:36.659746 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d82e0997-1413-454c-b318-ad0a50838183 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1504 microversion: 2.1 time: 0.263834 Dec 13 23:06:36.660311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 330/687] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:36 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:36.705954 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:36.706645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:36.712822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.713431 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.714338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:36.714826 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:36.867252 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:36.875608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-452d8374-0420-4764-9295-a2bee91c92c6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.173353 Dec 13 23:06:36.876203 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 358/688] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:36 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:37.472011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:37.473670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:37.479053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:37.479748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:37.480610 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:37.481084 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:37.635234 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:37.644129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:37.645715 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:37.646860 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-fc111039-bac3-4f0c-bd8c-18dd3e9d3518 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.179026 Dec 13 23:06:37.647424 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 331/689] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:37 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:37.677948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:37.678773 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:37.685800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:37.686244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:37.687092 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:37.687449 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:37.833945 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:37.842767 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-37eaf24f-ad69-4eb4-bd58-883e293681ba tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1504 microversion: 2.1 time: 0.169210 Dec 13 23:06:37.843398 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 359/690] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:37 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:37.893020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:37.893638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:37.900028 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:37.900466 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:37.901249 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:37.901706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:38.039576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:38.050252 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-da86aee8-21ef-4c8b-9950-884c46624405 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.160611 Dec 13 23:06:38.051912 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 332/691] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:37 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:38.666229 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:38.666862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:38.676874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:38.678155 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:38.679866 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:38.680300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:38.715862 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-0908bc48-76f3-4687-a48a-7542390f9599 req-c888635a-dede-4c88-b600-5240742a5509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6c7572-b807-4c04-9d8d-e407ff94016d", "name": "network-vif-deleted", "tag": "d032ffaf-1a34-4a11-a6a7-8199e3ce1ea0"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:38.717887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:38.717887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:38.733400 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-0908bc48-76f3-4687-a48a-7542390f9599 req-c888635a-dede-4c88-b600-5240742a5509 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:38.733846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-0908bc48-76f3-4687-a48a-7542390f9599 req-c888635a-dede-4c88-b600-5240742a5509 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:38.756560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-0908bc48-76f3-4687-a48a-7542390f9599 req-c888635a-dede-4c88-b600-5240742a5509 service nova] Creating event network-vif-deleted:d032ffaf-1a34-4a11-a6a7-8199e3ce1ea0 for instance 1c6c7572-b807-4c04-9d8d-e407ff94016d on hv-cinder-79628 Dec 13 23:06:38.761607 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-0908bc48-76f3-4687-a48a-7542390f9599 req-c888635a-dede-4c88-b600-5240742a5509 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050022 Dec 13 23:06:38.762374 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 333/692] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:38.861895 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:38.862664 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:38.863461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:38.869605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:38.870130 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:38.871053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:38.871586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:38.871804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:38.873684 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:38.874845 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b6562607-391e-4887-86ca-04f571d12eca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.212365 Dec 13 23:06:38.875634 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 360/693] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:38 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:38.903372 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:38.903950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:38.904241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lazy-loading 'fault' on Instance uuid 1c6c7572-b807-4c04-9d8d-e407ff94016d {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:06:38.944530 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:38.952895 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cbe74547-87fa-4a8e-afd5-59dd34f37e11 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 200 len: 1303 microversion: 2.1 time: 0.095153 Dec 13 23:06:38.953448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 334/694] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:38 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:39.069871 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:39.070481 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:39.077000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:39.077476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:39.078259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:39.078689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:39.218507 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:39.226977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-32bf2c3b-1226-476b-ac75-1e0de32e1af2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.160817 Dec 13 23:06:39.227526 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 361/695] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:39 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:39.896757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:39.897518 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:39.907074 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:39.907675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:39.908435 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:39.908916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:39.972861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:39.973494 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 1c6c7572-b807-4c04-9d8d-e407ff94016d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:39.980730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:39.981158 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:39.981985 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:39.982405 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:39.997082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] HTTP exception thrown: Instance 1c6c7572-b807-4c04-9d8d-e407ff94016d could not be found. Dec 13 23:06:39.997707 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Returning 404 to user: Instance 1c6c7572-b807-4c04-9d8d-e407ff94016d could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:06:39.998536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-36018aef-b57d-44a7-9b3c-03512253b868 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d" status: 404 len: 111 microversion: 2.1 time: 0.031313 Dec 13 23:06:39.999096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 362/696] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:39 2021] GET /compute/v2.1/servers/1c6c7572-b807-4c04-9d8d-e407ff94016d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:06:40.052514 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1054498885", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "networks": [{"uuid": "f2c49a7f-3da1-49ae-852a-b4db2605a7cd"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:40.068690 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:40.079224 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:40.080862 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:40.082128 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-26af848e-91eb-4ed8-b66e-031c840b2445 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.190835 Dec 13 23:06:40.082816 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 335/697] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:39 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:40.111086 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] validate_networks() for [('f2c49a7f-3da1-49ae-852a-b4db2605a7cd', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:06:40.245135 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:40.245698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:40.251984 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:40.252436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:40.253223 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:40.253783 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:40.474402 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:40.482892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8a08f12e-50c6-489e-8a54-583f70af2f03 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.242234 Dec 13 23:06:40.483492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 336/698] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:40 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:40.586464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:06:40.586881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:06:40.587349 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:06:40.587747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:06:40.588147 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:06:40.597713 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:40.598255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:40.599082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:40.599524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:40.616888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Getting quotas for project 29aac56f8b7648db9654aeb5eb465d73. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:06:40.621307 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Getting quotas for user 666cd56f5dba4ecba144c1be64791843 and project 29aac56f8b7648db9654aeb5eb465d73. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:06:40.633760 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:06:40.636101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:06:40.686482 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d048f987-bd94-4558-9f4e-fffcd733f447 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638863 Dec 13 23:06:40.687302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 363/699] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:06:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:06:40.696604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3918c4c0-57b4-4249-a534-89e99564c366 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:40.696784 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8ecde1f3-e8e5-442a-929c-cfd0431ae15f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:40.697217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3918c4c0-57b4-4249-a534-89e99564c366 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:40.703102 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ecde1f3-e8e5-442a-929c-cfd0431ae15f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:40.703550 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8ecde1f3-e8e5-442a-929c-cfd0431ae15f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:40.732672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8ecde1f3-e8e5-442a-929c-cfd0431ae15f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Going to try to stop instance {{(pid=116225) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 13 23:06:40.752504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3918c4c0-57b4-4249-a534-89e99564c366 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:40.761100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3918c4c0-57b4-4249-a534-89e99564c366 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1214 microversion: 2.1 time: 0.067857 Dec 13 23:06:40.762151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 364/700] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:40 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:40.780436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8ecde1f3-e8e5-442a-929c-cfd0431ae15f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 202 len: 0 microversion: 2.1 time: 0.087390 Dec 13 23:06:40.781216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 337/701] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:06:40 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:06:40.789429 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:40.790024 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:40.797868 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:40.798390 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:40.799266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:40.799779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:40.943194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:40.950799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b74d95dd-24b9-4ec3-8d05-afd15ab35372 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.165161 Dec 13 23:06:40.951451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 365/702] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:40 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:41.103548 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:41.104136 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:41.110487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.110937 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:41.111711 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.112173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:41.250531 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:41.259757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:41.261249 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:41.262441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1f0120df-9d13-40e5-9a5e-5d3a70d70d2b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.163633 Dec 13 23:06:41.262997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 338/703] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:41 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:41.504320 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:41.504971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:41.513301 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.513908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:41.514921 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.515469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:41.675033 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:41.683632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ba84e204-5037-4852-930c-d58a6660c44e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.185747 Dec 13 23:06:41.684223 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 366/704] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:41 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:41.783055 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:41.783932 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:41.790759 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.791207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:41.791985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.792441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:41.853134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:41.861017 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bc0a8f30-4783-4d56-bd90-e16ee9a552ce tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1218 microversion: 2.1 time: 0.084284 Dec 13 23:06:41.861612 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 339/705] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:41 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:41.968562 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:41.969168 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:41.976659 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.977105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:41.977935 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:41.978372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:42.121290 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:42.130956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-939671a7-5480-4a52-86ca-361a4949f320 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.166308 Dec 13 23:06:42.131542 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 367/706] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:41 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:42.285105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:42.285928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:42.292516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:42.292956 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:42.293766 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:42.294189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:42.440023 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:42.450041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:42.451503 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:42.452658 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2bb640fb-3325-443a-aa92-b2daedebd540 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.173882 Dec 13 23:06:42.453255 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 340/707] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:42 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:42.704662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:42.705429 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:42.713000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:42.713466 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:42.714504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:42.715077 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:42.846691 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:42.858640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-db8bbf05-49a9-4386-bc73-e31f895bf27f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.159838 Dec 13 23:06:42.859462 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 368/708] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:42 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:42.879423 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:42.879423 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:42.885591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:42.885999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:42.886772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:42.887196 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:42.950315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:42.958041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-98ede1ce-0685-410b-af24-154288a12b39 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1218 microversion: 2.1 time: 0.083522 Dec 13 23:06:42.958531 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 341/709] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:42 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:43.151860 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:43.152731 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:43.159160 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.159710 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:43.160551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.160951 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:43.310640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:43.318986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-43cbcc8f-02d2-4066-a0bb-dd4d7ac9c46e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.170911 Dec 13 23:06:43.319562 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 369/710] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:43 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:43.482072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:43.482943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:43.492259 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.492713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:43.493549 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.493981 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:43.636118 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:43.645235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:43.647021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:43.648340 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-406293f3-631f-4f48-b1b3-95bc1bd99cb7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.173032 Dec 13 23:06:43.649050 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 342/711] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:43 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:43.877193 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:43.878110 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:43.884478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.884926 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:43.885748 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.886227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:43.976215 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:43.977116 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:43.984806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.985255 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:43.986093 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:43.986521 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:44.090949 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:44.100355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3fc1fe24-4cc6-41a1-acd9-027acdd7b5aa tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1272 microversion: 2.1 time: 0.129242 Dec 13 23:06:44.100941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 343/712] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:43 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:44.156183 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:44.164875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-346e46ac-095c-45b6-9917-b7172908c48d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.291563 Dec 13 23:06:44.165461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 370/713] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:43 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:44.336374 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:44.336888 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:44.343237 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:44.343689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:44.344478 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:44.344911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:44.566486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:44.574302 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-acc258cf-0d03-4365-b2e5-0a2455ca3383 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.241701 Dec 13 23:06:44.575138 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 344/714] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:44 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:44.670346 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:44.671248 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:44.681746 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:44.682478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:44.683656 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:44.684319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:44.827087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:44.835617 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:44.837105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:44.838282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ad5b7d4-6da8-43b4-ac8d-3aea85e4ae67 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.173809 Dec 13 23:06:44.838917 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 371/715] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:44 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:45.118396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:45.119066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:45.126022 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.126462 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:45.127234 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.127664 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:45.182373 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:45.182993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:45.189968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.190444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:45.191320 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.191735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:45.288585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:45.296256 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-60dcd77f-f0d7-4d3b-ad2c-425468df79e9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.181879 Dec 13 23:06:45.296829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 345/716] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:45 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:45.353227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:45.365082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b79ccdad-85d3-45d5-b6e0-f86a319b29a2 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.186161 Dec 13 23:06:45.365876 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 372/717] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:45 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:45.595963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:45.596923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:45.607850 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.608484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:45.609813 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.610530 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:45.753810 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:45.762104 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ca44c614-c5df-48f7-b5f6-093271c67265 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.172333 Dec 13 23:06:45.762677 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 346/718] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:45 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:45.860755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:45.861656 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:45.868823 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.869266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:45.870066 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:45.870507 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:46.015572 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:46.024225 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:46.025750 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:46.026940 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2d56d16a-b529-4aee-8ad0-667bca2b5c13 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.172556 Dec 13 23:06:46.027500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 373/719] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:45 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:46.314317 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:46.314946 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:46.323231 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:46.323797 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:46.324983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:46.325683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:46.386907 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:46.387496 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:46.394107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:46.394648 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:46.395437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:46.395863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:46.611652 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:46.619018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5b74624a-2687-4524-8e9e-6b5b2edf5617 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.308480 Dec 13 23:06:46.619575 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 347/720] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:46 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:46.679795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:46.688024 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-058d9f8b-0d53-4d16-ad72-0352af513007 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.304850 Dec 13 23:06:46.688591 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 374/721] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:46 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:46.779999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:46.780881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:46.787751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:46.788161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:46.788962 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:46.789387 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.046206 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:47.046802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:47.054796 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:47.055228 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.056068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:47.056615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.170806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:47.180127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-371fb298-fa3c-4f28-81bf-e0d86b7618a0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.403808 Dec 13 23:06:47.181244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 348/722] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:46 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:47.282654 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-15f44376-e452-4dda-b16c-f842dfdfbe49 req-98f46172-9724-4985-b920-f15d78492dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ed7a02-5035-4022-8e68-1cc8a0742684", "tag": "c0fa4276-8d3b-44b3-b46d-e1ce7611fd50"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:47.285175 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:47.285175 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:47.303137 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-15f44376-e452-4dda-b16c-f842dfdfbe49 req-98f46172-9724-4985-b920-f15d78492dcc service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:47.303137 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-15f44376-e452-4dda-b16c-f842dfdfbe49 req-98f46172-9724-4985-b920-f15d78492dcc service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.314807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-15f44376-e452-4dda-b16c-f842dfdfbe49 req-98f46172-9724-4985-b920-f15d78492dcc service nova] Creating event network-changed:c0fa4276-8d3b-44b3-b46d-e1ce7611fd50 for instance 72ed7a02-5035-4022-8e68-1cc8a0742684 on hv-cinder-79628 Dec 13 23:06:47.320351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-15f44376-e452-4dda-b16c-f842dfdfbe49 req-98f46172-9724-4985-b920-f15d78492dcc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044923 Dec 13 23:06:47.321276 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 349/723] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:06:47.356303 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:47.366645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:47.368643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:47.371861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-eb5487ca-aeba-4171-8deb-ee17bd3759d5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.328596 Dec 13 23:06:47.378075 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 375/724] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:47 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:47.643447 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:47.644286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:47.651440 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:47.651887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.652689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:47.653127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.706713 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:47.707388 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:47.714874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:47.715634 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.716502 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:47.716980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:47.900097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:47.907769 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3ab89d1a-2204-4a01-81b4-8ccdec33b8cd tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.273061 Dec 13 23:06:47.908354 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 350/725] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:47 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:47.946100 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:47.954720 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cbdb4691-dc7b-43d2-a10d-34e72b8d0fd0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.252705 Dec 13 23:06:47.955486 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 376/726] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:47 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:48.199231 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:48.200371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:48.209604 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.210053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:48.210858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.211484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:48.391062 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:48.391665 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:48.398802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.399337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:48.400102 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.400543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:48.457222 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:48.465508 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d1600970-eb14-4f17-96d6-3cb8fe0152ee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.271492 Dec 13 23:06:48.466142 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 351/727] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:48 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:48.569511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:48.577862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:48.579336 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:48.580536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-34dc49e6-b175-4cf1-acae-fb1006b9aed3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.193323 Dec 13 23:06:48.581106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 377/728] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:48 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:48.925366 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:48.926441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:48.932872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.933312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:48.934128 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.934557 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:48.972300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:48.972992 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:48.979904 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.980605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:48.981402 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:48.981867 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:49.102652 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:49.110526 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-eb231264-b246-436f-98a8-a8d6867ac38b tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.188833 Dec 13 23:06:49.111160 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 352/729] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:48 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:49.145370 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:49.153258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e6fa5427-40ca-419c-92f0-bbc679fd07aa tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.185090 Dec 13 23:06:49.153886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 378/730] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:48 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:49.265941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-b1d919b0-6fee-4092-92d1-345554053a80 req-dcd12daa-dc82-43e5-9ee3-1e13dff513ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168526af-2c4e-4e84-8b87-7f2e71d96e16", "name": "network-vif-plugged", "status": "completed", "tag": "ef742767-361d-4046-8bd3-5b8f1c34e632"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:49.267556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:49.267556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:06:49.275547 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-b1d919b0-6fee-4092-92d1-345554053a80 req-dcd12daa-dc82-43e5-9ee3-1e13dff513ec service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:49.276097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-b1d919b0-6fee-4092-92d1-345554053a80 req-dcd12daa-dc82-43e5-9ee3-1e13dff513ec service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:49.287330 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-b1d919b0-6fee-4092-92d1-345554053a80 req-dcd12daa-dc82-43e5-9ee3-1e13dff513ec service nova] Creating event network-vif-plugged:ef742767-361d-4046-8bd3-5b8f1c34e632 for instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 on hv-cinder-79628 Dec 13 23:06:49.292371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-b1d919b0-6fee-4092-92d1-345554053a80 req-dcd12daa-dc82-43e5-9ee3-1e13dff513ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030104 Dec 13 23:06:49.292963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 353/731] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:49.487033 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:49.488310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:49.499243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:49.499975 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:49.501209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:49.501913 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:49.600060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:49.600758 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:49.623103 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:49.623473 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:49.624407 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:49.624738 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:49.663776 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:49.671545 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8cebb531-7234-4afb-b3f0-877adc8fc0ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.191042 Dec 13 23:06:49.672126 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 379/732] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:49 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:49.778580 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:49.789178 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:49.790757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:49.792177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5a9531db-5f9f-4f8a-8968-32394f5a260a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.197278 Dec 13 23:06:49.793108 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 354/733] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:49 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:50.132303 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:50.133035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:50.141481 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.142033 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.142853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.143304 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.171633 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:50.172199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:50.178791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.179231 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.180013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.180439 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.342001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:50.349834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b490e66d-0cd1-411d-bb9a-112646dc6e31 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.223396 Dec 13 23:06:50.350536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 380/734] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:50 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:50.365173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:50.376451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e869320d-1592-4051-86ff-65320378f12d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1567 microversion: 2.1 time: 0.208714 Dec 13 23:06:50.377216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 355/735] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:50 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:50.689369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:50.689895 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:50.695854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.696302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.697069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.697527 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.813042 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:50.813881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:50.821469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.821914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.822677 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:50.823100 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:50.840324 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:50.847722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5be85cc5-f878-46ec-b654-97b091636e78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.162295 Dec 13 23:06:50.848312 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 381/736] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:50 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:50.956806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:50.968868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:50.971280 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:50.973166 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-80a50177-e7f8-47fe-8871-6b4424e2250f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.165776 Dec 13 23:06:50.974005 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 356/737] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:50 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:06:51.366665 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:51.367269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:51.374153 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.374529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.375338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.375762 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.395778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:51.396868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:51.402682 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.403208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.404097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.404522 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.575697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:51.583615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d52577e3-ee0c-4138-b3c8-0b64bb73ba82 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.220548 Dec 13 23:06:51.584334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 382/738] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:51 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:51.589025 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:51.589548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:51.595754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.596204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.596986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.597452 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.597617 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:51.606376 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2e4e4fdc-3051-44a1-809a-c8eec7c4f586 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1547 microversion: 2.1 time: 0.215761 Dec 13 23:06:51.607157 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 357/739] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:51 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1547 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:51.623068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:51.623644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:51.629563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.631576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.632822 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.633357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.679868 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lazy-loading 'services' on Instance uuid af221e52-2be9-41ab-b621-9a4596812cb3 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:06:51.716389 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] HTTP exception thrown: Cannot 'detach_volume' instance f930f2d2-ece8-408b-aad2-fcb48bac226d while it is in vm_state rescued Dec 13 23:06:51.717112 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Returning 409 to user: Cannot 'detach_volume' instance f930f2d2-ece8-408b-aad2-fcb48bac226d while it is in vm_state rescued {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:06:51.718068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ed55dc52-7be2-4131-a99a-e9f499cb023d tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments/8bd97556-1435-4265-a13b-8a02502a4e9b" status: 409 len: 152 microversion: 2.1 time: 0.098882 Dec 13 23:06:51.718840 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 358/740] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:06:51 2021] DELETE /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments/8bd97556-1435-4265-a13b-8a02502a4e9b => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 13 23:06:51.727185 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1095398b-10e1-45c8-bbc9-ccedf75385ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:51.727874 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1095398b-10e1-45c8-bbc9-ccedf75385ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:51.735320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1095398b-10e1-45c8-bbc9-ccedf75385ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.735775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1095398b-10e1-45c8-bbc9-ccedf75385ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.736568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1095398b-10e1-45c8-bbc9-ccedf75385ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.737006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1095398b-10e1-45c8-bbc9-ccedf75385ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.759458 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2866b017-966c-4fca-92c6-3eead5045d39 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3/os-volume_attachments/72ba09dc-ab71-40a4-aaff-3d0fd59b8345" status: 202 len: 0 microversion: 2.1 time: 0.173761 Dec 13 23:06:51.759968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 383/741] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:06:51 2021] DELETE /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3/os-volume_attachments/72ba09dc-ab71-40a4-aaff-3d0fd59b8345 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:06:51.805798 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1095398b-10e1-45c8-bbc9-ccedf75385ae tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action" status: 202 len: 0 microversion: 2.1 time: 0.082144 Dec 13 23:06:51.806413 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 359/742] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:06:51 2021] POST /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:06:51.815450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:51.816478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:51.825284 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.825772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.826656 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.827186 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.866890 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:51.867592 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:51.886017 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.886717 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:51.887672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:51.888596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:52.173109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:52.182660 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e7081fd0-34d5-4025-a1dd-1affaa45545a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1555 microversion: 2.1 time: 0.371590 Dec 13 23:06:52.183335 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 384/743] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:51 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1555 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:52.189178 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:52.190097 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:52.195395 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:52.199112 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:52.199551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:52.200332 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:52.200754 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:52.207422 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a0babfc2-d737-4ab8-914b-d49b3029e3bf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.345998 Dec 13 23:06:52.208558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 360/744] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:51 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:52.451886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:52.461712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:52.463270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:52.464547 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-099215e9-5919-42fa-a131-5b8e3e1ed415 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1806 microversion: 2.20 time: 0.279461 Dec 13 23:06:52.465148 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 385/745] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:52 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1806 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:52.601563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:52.602289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:52.609668 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:52.610439 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:52.611518 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:52.612053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:52.754350 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:52.764586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0ab6d86b-95bb-4d47-be8d-58af3ac86db6 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.166977 Dec 13 23:06:52.765365 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 361/746] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:52 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:53.200032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:53.200695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:53.207140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.207610 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.208750 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.208985 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.225036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:53.225689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:53.232600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.233061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.234057 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.234504 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.414975 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:53.418687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:53.425550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cc450af8-2a8e-48ea-b315-42a14d1f3b22 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1555 microversion: 2.1 time: 0.228723 Dec 13 23:06:53.426427 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ff169caf-93da-4fad-9244-0a5d519ce166 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.205446 Dec 13 23:06:53.426868 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 386/747] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:53 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:53.433666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 362/748] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:53 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:53.440541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-9be278db-3560-418f-a177-d6ed2e99c297 req-237497ad-b99f-415e-ad04-21d57c6edd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ed7a02-5035-4022-8e68-1cc8a0742684", "name": "network-vif-plugged", "status": "completed", "tag": "c0fa4276-8d3b-44b3-b46d-e1ce7611fd50"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:53.442135 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:53.442135 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:06:53.449947 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-9be278db-3560-418f-a177-d6ed2e99c297 req-237497ad-b99f-415e-ad04-21d57c6edd09 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.450389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-9be278db-3560-418f-a177-d6ed2e99c297 req-237497ad-b99f-415e-ad04-21d57c6edd09 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.461578 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-9be278db-3560-418f-a177-d6ed2e99c297 req-237497ad-b99f-415e-ad04-21d57c6edd09 service nova] Creating event network-vif-plugged:c0fa4276-8d3b-44b3-b46d-e1ce7611fd50 for instance 72ed7a02-5035-4022-8e68-1cc8a0742684 on hv-cinder-79628 Dec 13 23:06:53.466260 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-9be278db-3560-418f-a177-d6ed2e99c297 req-237497ad-b99f-415e-ad04-21d57c6edd09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031012 Dec 13 23:06:53.467089 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 387/749] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:53.483211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:53.483943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:53.490385 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.490858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.491698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.492130 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.646712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:53.658683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:53.661176 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:53.663019 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8c235488-4a66-44b5-9996-5ce2896cdd06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1793 microversion: 2.20 time: 0.183209 Dec 13 23:06:53.664270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 363/750] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:06:53 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1793 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:06:53.783106 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:53.783784 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:53.790325 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.790768 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.791529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.791953 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.936822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:53.941438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:53.941438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:53.944996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6601802b-67e5-4995-8ce0-256aefb7de41 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.165925 Dec 13 23:06:53.945629 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 388/751] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:53 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:53.946883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.947328 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.948109 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:53.948535 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:53.973545 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:06:54.058995 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1a2fb574-e056-4581-8c90-95cc0ee6c396 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 204 len: 0 microversion: 2.1 time: 0.122410 Dec 13 23:06:54.060979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 364/752] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:06:53 2021] DELETE /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:06:54.069643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:54.070259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:54.076974 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.077480 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:54.078263 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.078700 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:54.208828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:54.216460 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-82e6e810-6d5d-4d36-b3f3-8caae68b5275 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1513 microversion: 2.1 time: 0.150798 Dec 13 23:06:54.217078 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 389/753] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:54 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:54.448739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:54.449187 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:54.449697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:54.450432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:54.459607 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.459787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.460031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:54.460265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:54.460852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.460995 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.461474 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:54.461615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:54.652926 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:54.656199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:54.660994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8cdb2fc4-4a2a-4fcc-b18d-21eb4efbd09f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1555 microversion: 2.1 time: 0.218423 Dec 13 23:06:54.661580 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 390/754] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:54 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:54.664854 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9a8fa773-cb50-4ef5-93b7-e4534b524f17 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.222673 Dec 13 23:06:54.665433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 365/755] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:54 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:54.963444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:54.964048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:54.970599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.971039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:54.971804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:54.972226 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.109991 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:55.117859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-35794337-80cc-4bc4-b183-8b797c6ef646 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1314 microversion: 2.1 time: 0.158187 Dec 13 23:06:55.118410 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 391/756] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:54 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:55.237628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:55.238524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:55.245640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.246113 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.246968 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.247415 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.381911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:55.390009 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-60415e49-32fa-48f4-94df-0fbddfc1ba2f tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1513 microversion: 2.1 time: 0.158674 Dec 13 23:06:55.390723 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 366/757] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:55 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:55.680233 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:55.681094 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:55.682270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:55.682894 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:55.687986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.689033 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.689839 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.690267 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.690397 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.690713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.691501 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.692305 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.884844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:55.889308 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:55.892777 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9ef93f06-41c0-459b-a3e3-60d750f64ce5 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1561 microversion: 2.1 time: 0.217253 Dec 13 23:06:55.893364 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 392/758] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:55 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:55.897539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ae9e57dd-06bb-447d-b39a-ada7955adddd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.218881 Dec 13 23:06:55.898312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 367/759] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:55 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:55.960416 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:55.960913 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:55.967346 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.967791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:55.968567 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:55.968996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.052160 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lazy-loading 'services' on Instance uuid f930f2d2-ece8-408b-aad2-fcb48bac226d {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:06:56.126734 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2e60f89d-cd60-4ee2-98ae-0d4d68ede42e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments/8bd97556-1435-4265-a13b-8a02502a4e9b" status: 202 len: 0 microversion: 2.1 time: 0.170085 Dec 13 23:06:56.127728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 393/760] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:06:55 2021] DELETE /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments/8bd97556-1435-4265-a13b-8a02502a4e9b => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:06:56.136124 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-15005549-7b46-47e2-b798-08055f250840 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:56.137138 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-15005549-7b46-47e2-b798-08055f250840 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:56.138666 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:56.138984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:56.143126 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-15005549-7b46-47e2-b798-08055f250840 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.143567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-15005549-7b46-47e2-b798-08055f250840 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.144376 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-15005549-7b46-47e2-b798-08055f250840 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.144839 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-15005549-7b46-47e2-b798-08055f250840 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.145530 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.146055 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.146940 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.147422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.177248 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-15005549-7b46-47e2-b798-08055f250840 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Dec 13 23:06:56.178174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 368/761] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:06:56 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:56.284102 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:56.291697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-08bab099-bae5-4725-ab5a-ba844a971d50 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1498 microversion: 2.1 time: 0.157400 Dec 13 23:06:56.292281 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 394/762] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:56 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:56.411728 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:56.412369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:56.418296 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.418750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.419506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.419951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.554370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:56.561975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b62e34fe-1382-4541-a701-3f927309ee47 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1513 microversion: 2.1 time: 0.156789 Dec 13 23:06:56.562615 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 369/763] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:56 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:56.840759 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:56.841285 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:56.847834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.848292 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.849652 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.850085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.875998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:06:56.915890 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:56.916654 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:56.923300 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.923720 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.924512 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.924947 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.961616 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-680f7908-e56f-4f29-a9f9-d8220e9f7cc3 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "DELETE /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 204 len: 0 microversion: 2.1 time: 0.123772 Dec 13 23:06:56.962916 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 395/764] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:06:56 2021] DELETE /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:06:56.978361 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:56.979370 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:56.986822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.987532 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:56.988548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:56.989552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:57.229499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:57.237299 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-401dee45-d408-425b-a518-505e69788bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.325800 Dec 13 23:06:57.238004 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 370/765] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:56 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:57.242973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9bcd4552-4594-4fa9-a6f8-6748adac15d0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:57.243866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9bcd4552-4594-4fa9-a6f8-6748adac15d0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:57.249983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bcd4552-4594-4fa9-a6f8-6748adac15d0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:57.250431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bcd4552-4594-4fa9-a6f8-6748adac15d0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:57.251212 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bcd4552-4594-4fa9-a6f8-6748adac15d0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:57.251642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bcd4552-4594-4fa9-a6f8-6748adac15d0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:57.272664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:57.281029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a61d3dc7-511c-4c9f-8d8a-57667d716919 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1504 microversion: 2.1 time: 0.313838 Dec 13 23:06:57.281834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 396/766] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:56 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:06:57.282629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9bcd4552-4594-4fa9-a6f8-6748adac15d0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043287 Dec 13 23:06:57.283608 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 371/767] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:06:57 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:06:57.554812 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-00414103-6aaf-4151-93d5-4ea9a71568e2 req-9271c2bd-3054-4097-a7ee-d4d1dae941ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af221e52-2be9-41ab-b621-9a4596812cb3", "name": "network-vif-deleted", "tag": "28096ea4-0a35-41bd-92d2-396aa7f752cd"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:57.556440 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:57.556440 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:06:57.563888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-00414103-6aaf-4151-93d5-4ea9a71568e2 req-9271c2bd-3054-4097-a7ee-d4d1dae941ff service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:57.564332 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-00414103-6aaf-4151-93d5-4ea9a71568e2 req-9271c2bd-3054-4097-a7ee-d4d1dae941ff service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:57.577955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-00414103-6aaf-4151-93d5-4ea9a71568e2 req-9271c2bd-3054-4097-a7ee-d4d1dae941ff service nova] Creating event network-vif-deleted:28096ea4-0a35-41bd-92d2-396aa7f752cd for instance af221e52-2be9-41ab-b621-9a4596812cb3 on hv-cinder-79628 Dec 13 23:06:57.580144 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:57.580846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:57.584189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-00414103-6aaf-4151-93d5-4ea9a71568e2 req-9271c2bd-3054-4097-a7ee-d4d1dae941ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Dec 13 23:06:57.584638 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 397/768] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:57.588868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:57.589317 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:57.590127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:57.590561 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:57.661926 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e442d32351e74eda9e6eb7f01c15f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a736ec919343435d98e16479a93c4119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:57.669769 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-023aa313-12ec-4dd0-99f9-517bc8450b02 tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 200 len: 1303 microversion: 2.1 time: 0.093695 Dec 13 23:06:57.670638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 372/769] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:57 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:58.256880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:58.257606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:58.264436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:58.264847 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:58.265699 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:58.266134 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:58.302619 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:58.304392 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:58.311454 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:58.312048 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:58.313091 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:58.313699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:58.439984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:58.447959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-683fd9f3-533f-45c9-a250-f28b6a8397d4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1676 microversion: 2.1 time: 0.196106 Dec 13 23:06:58.448511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 398/770] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:58 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:58.497979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:58.506162 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d94f86d0-873c-4ab8-9499-576aa89f5593 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1504 microversion: 2.1 time: 0.209769 Dec 13 23:06:58.506758 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 373/771] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:58 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:58.688295 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:58.688898 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] [instance: af221e52-2be9-41ab-b621-9a4596812cb3] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:58.696877 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:58.697542 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:58.698865 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:58.699300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:58.714992 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] HTTP exception thrown: Instance af221e52-2be9-41ab-b621-9a4596812cb3 could not be found. Dec 13 23:06:58.715585 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] Returning 404 to user: Instance af221e52-2be9-41ab-b621-9a4596812cb3 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:06:58.716450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a264de3c-d643-4bd9-89a1-63cf6469114d tempest-VolumesSnapshotTestJSON-1628711192 tempest-VolumesSnapshotTestJSON-1628711192-project] 10.222.0.13 "GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3" status: 404 len: 111 microversion: 2.1 time: 0.031878 Dec 13 23:06:58.717011 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 399/772] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:58 2021] GET /compute/v2.1/servers/af221e52-2be9-41ab-b621-9a4596812cb3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:06:59.466987 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:59.467589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:59.475903 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.476348 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.477122 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.477576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.523875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:59.524468 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:59.531270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.531747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.532528 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.532971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.564756 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.565199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.565674 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lazy-loading 'fault' on Instance uuid 72ed7a02-5035-4022-8e68-1cc8a0742684 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:06:59.621037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666cd56f5dba4ecba144c1be64791843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aac56f8b7648db9654aeb5eb465d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:59.628443 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-85a54eb2-b3a8-4274-8281-4792fb8372b9 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 200 len: 1304 microversion: 2.1 time: 0.108364 Dec 13 23:06:59.629008 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 400/773] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:59 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:59.638523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-31a3f353-e8b5-4ce0-ba55-6d775562c432 req-8bda7805-7a64-4132-9be9-e2d217e31695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ed7a02-5035-4022-8e68-1cc8a0742684", "name": "network-vif-deleted", "tag": "c0fa4276-8d3b-44b3-b46d-e1ce7611fd50"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:59.638523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:06:59.638523 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:06:59.641795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-31a3f353-e8b5-4ce0-ba55-6d775562c432 req-8bda7805-7a64-4132-9be9-e2d217e31695 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.642240 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-31a3f353-e8b5-4ce0-ba55-6d775562c432 req-8bda7805-7a64-4132-9be9-e2d217e31695 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.643043 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:06:59.650870 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2fc23bf5-b2a2-4cd3-a659-dcda1ea73642 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1653 microversion: 2.1 time: 0.188717 Dec 13 23:06:59.651432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 374/774] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:59 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1653 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:06:59.652900 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-31a3f353-e8b5-4ce0-ba55-6d775562c432 req-8bda7805-7a64-4132-9be9-e2d217e31695 service nova] Creating event network-vif-deleted:c0fa4276-8d3b-44b3-b46d-e1ce7611fd50 for instance 72ed7a02-5035-4022-8e68-1cc8a0742684 on hv-cinder-79628 Dec 13 23:06:59.655622 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:59.656969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:59.657671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-31a3f353-e8b5-4ce0-ba55-6d775562c432 req-8bda7805-7a64-4132-9be9-e2d217e31695 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027523 Dec 13 23:06:59.658251 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 401/775] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:06:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:06:59.663918 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.664380 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.665161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.665611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.667793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bb0cb271-2e9c-4328-b89c-4c4c1b85780e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:06:59.673886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb0cb271-2e9c-4328-b89c-4c4c1b85780e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.674334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bb0cb271-2e9c-4328-b89c-4c4c1b85780e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.690559 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:06:59.698674 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bb0cb271-2e9c-4328-b89c-4c4c1b85780e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Going to try to start instance {{(pid=116226) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 13 23:06:59.746640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bb0cb271-2e9c-4328-b89c-4c4c1b85780e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action" status: 202 len: 0 microversion: 2.1 time: 0.082294 Dec 13 23:06:59.747235 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 402/776] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:06:59 2021] POST /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:06:59.755896 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:59.756685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:59.763059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.763480 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.764269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.764690 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.784685 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2d33906a-44fd-4e25-8760-6d1a1d29fe37 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 204 len: 0 microversion: 2.1 time: 0.131855 Dec 13 23:06:59.785931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 375/777] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:06:59 2021] DELETE /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:06:59.798685 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:06:59.799916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:06:59.807010 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.807542 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:06:59.808580 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:06:59.809069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:00.065557 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:00.074469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c605cde7-5a64-423f-9f52-2bfbcbf85acf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1662 microversion: 2.1 time: 0.322501 Dec 13 23:07:00.075092 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 403/778] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:59 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1662 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:07:00.113677 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:00.123243 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-af8baf08-6a7d-44d5-86eb-5f8518bc0a93 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.332600 Dec 13 23:07:00.124062 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 376/779] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:06:59 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:00.650340 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:00.651378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] [instance: 72ed7a02-5035-4022-8e68-1cc8a0742684] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:00.662110 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:00.662571 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:00.663357 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:00.663799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:00.677761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] HTTP exception thrown: Instance 72ed7a02-5035-4022-8e68-1cc8a0742684 could not be found. Dec 13 23:07:00.678285 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] Returning 404 to user: Instance 72ed7a02-5035-4022-8e68-1cc8a0742684 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:07:00.679123 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c7db062b-2547-44a0-b589-4faac1683787 tempest-VolumesActionsTest-991775693 tempest-VolumesActionsTest-991775693-project] 10.222.0.13 "GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684" status: 404 len: 111 microversion: 2.1 time: 0.035307 Dec 13 23:07:00.679634 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 404/780] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:00 2021] GET /compute/v2.1/servers/72ed7a02-5035-4022-8e68-1cc8a0742684 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:07:01.091565 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:01.092261 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:01.101503 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:01.101945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:01.102731 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:01.103155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:01.141236 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:01.141948 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:01.149220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:01.149734 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:01.150447 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:01.151172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:01.286210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:01.294533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f7fd5609-e42a-450a-8d82-530b29ac4d12 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1662 microversion: 2.1 time: 0.206654 Dec 13 23:07:01.295657 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 377/781] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:01 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1662 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:01.331330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:01.338894 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3f5a936e-38b0-4574-b2ec-a054f4be219f tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.201569 Dec 13 23:07:01.339528 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 405/782] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:01 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:07:02.314030 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:02.314829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:02.322330 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:02.322754 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:02.323554 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:02.323977 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:02.355912 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:02.356592 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:02.363721 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:02.364959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:02.365890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:02.366333 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:02.488438 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:02.496866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-11674b9d-0226-41cc-aa33-40c0152b3a54 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1662 microversion: 2.1 time: 0.187682 Dec 13 23:07:02.497516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 378/783] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:02 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1662 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:02.536606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:02.544490 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d33a930a-3be8-4fef-99b5-a396cfe7d0be tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.192258 Dec 13 23:07:02.545059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 406/784] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:02 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:03.514958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:03.515641 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:03.522083 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:03.522579 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:03.523945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:03.524370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:03.562068 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:03.562671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:03.569495 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:03.570109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:03.570978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:03.571507 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:03.698120 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:03.706207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-44c97e3c-4ef0-42bd-aa52-d2ddee7578a1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1662 microversion: 2.1 time: 0.195262 Dec 13 23:07:03.706787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 379/785] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:03 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1662 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:03.747147 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:03.754687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-55ea5da7-1a4c-42e6-84d3-83cbc127bea9 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.196369 Dec 13 23:07:03.755260 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 407/786] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:03 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:04.726324 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:04.727080 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:04.733529 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:04.733974 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:04.734746 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:04.735174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:04.771498 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:04.772053 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:04.778781 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:04.779218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:04.779995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:04.780477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:04.904620 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:04.912598 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7e738d3f-bc7b-4c6f-a854-2c3861649feb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1662 microversion: 2.1 time: 0.190204 Dec 13 23:07:04.913171 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 380/787] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:04 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1662 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:04.950020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:04.957809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-948cb6b1-0230-413d-9673-9c42854e46f4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.189837 Dec 13 23:07:04.958386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 408/788] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:04 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:07:05.934656 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:05.935812 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:05.948430 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:05.949034 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:05.949883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:05.950324 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:05.975537 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:05.976291 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:05.983322 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:05.983774 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:05.984549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:05.984981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:06.138083 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:06.145929 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a5eab028-79d7-4224-b353-a8b8a1eb2000 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1662 microversion: 2.1 time: 0.217628 Dec 13 23:07:06.146499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 381/789] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:05 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1662 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:06.163804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:06.172057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a408a36-16f7-4007-bf1c-700dde876ee3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.200269 Dec 13 23:07:06.172659 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 409/790] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:05 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:07.167332 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:07.167866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:07.174585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:07.175034 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:07.176177 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:07.176609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:07.188697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:07.189384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:07.196048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:07.196491 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:07.197292 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:07.197835 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:07.388847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:07.402837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-14c45629-18ca-4399-a61e-b12bbb377d58 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1666 microversion: 2.1 time: 0.241259 Dec 13 23:07:07.403699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 382/791] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:07 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1666 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:07.410030 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:07.420970 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e5e4fb83-1135-4152-b25b-da7390849fec tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.235759 Dec 13 23:07:07.421625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 410/792] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:07 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:08.439915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:08.441156 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:08.448041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:08.448768 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:08.450068 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:08.450706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:08.711811 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:08.723067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ecb809b0-3ec3-4e31-8a66-e7acbe8078b1 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1508 microversion: 2.1 time: 0.287718 Dec 13 23:07:08.734937 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 383/793] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:08 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:09.392996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-0bae689b-e605-4edc-921a-28f1f11a9ea6 req-19317e45-268c-411d-b852-8f7e4057680e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad7412a-5ada-4048-a735-b557f4868be5", "name": "network-vif-deleted", "tag": "64ee4b02-4e4c-45cd-af6e-2d1e7a92f1e9"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:09.394704 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:07:09.394704 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:07:09.404500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0bae689b-e605-4edc-921a-28f1f11a9ea6 req-19317e45-268c-411d-b852-8f7e4057680e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:09.405757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0bae689b-e605-4edc-921a-28f1f11a9ea6 req-19317e45-268c-411d-b852-8f7e4057680e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:09.424433 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-0bae689b-e605-4edc-921a-28f1f11a9ea6 req-19317e45-268c-411d-b852-8f7e4057680e service nova] Creating event network-vif-deleted:64ee4b02-4e4c-45cd-af6e-2d1e7a92f1e9 for instance 8ad7412a-5ada-4048-a735-b557f4868be5 on hv-cinder-79628 Dec 13 23:07:09.432541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-0bae689b-e605-4edc-921a-28f1f11a9ea6 req-19317e45-268c-411d-b852-8f7e4057680e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043034 Dec 13 23:07:09.437768 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 411/794] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:07:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:07:09.741900 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:09.742850 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:09.750205 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:09.751023 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:09.751986 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:09.752675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:09.785969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:09.786761 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:09.787424 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lazy-loading 'fault' on Instance uuid 8ad7412a-5ada-4048-a735-b557f4868be5 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:07:09.848495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:09.858018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-21d0faaf-5f2c-4b9e-aebe-85ab72849671 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 200 len: 1312 microversion: 2.1 time: 0.120044 Dec 13 23:07:09.858875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 384/795] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:09 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:10.876327 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:10.877037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: 8ad7412a-5ada-4048-a735-b557f4868be5] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:10.883757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:10.884198 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:10.885002 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:10.885489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:10.900585 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] HTTP exception thrown: Instance 8ad7412a-5ada-4048-a735-b557f4868be5 could not be found. Dec 13 23:07:10.901178 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Returning 404 to user: Instance 8ad7412a-5ada-4048-a735-b557f4868be5 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:07:10.902043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-baba5196-983d-4176-8a60-c2387d316f3a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5" status: 404 len: 111 microversion: 2.1 time: 0.029837 Dec 13 23:07:10.902621 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 412/796] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:10 2021] GET /compute/v2.1/servers/8ad7412a-5ada-4048-a735-b557f4868be5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:07:10.910668 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:10.911164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:10.919286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:10.920020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:10.921028 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:10.921485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:10.950772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:07:11.046357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3d054c07-796d-4030-a8b3-2e04fc017cfb tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 204 len: 0 microversion: 2.1 time: 0.139049 Dec 13 23:07:11.047752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 385/797] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:07:10 2021] DELETE /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:07:11.056103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:11.056716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:11.069003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:11.069912 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:11.070871 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:11.071447 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:11.225309 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:11.233269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-61ff0a2f-a7c6-41f2-902b-2024ccc7fa4e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.180998 Dec 13 23:07:11.233893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 413/798] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:11 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:07:12.251046 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:12.252456 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:12.261014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:12.261633 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:12.262609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:12.263047 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:12.422916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:12.431735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3f28adba-3d1c-42f2-b727-d95bf1c00ff6 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.184973 Dec 13 23:07:12.432293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 386/799] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:12 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:13.448253 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:13.448956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:13.461826 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:13.466864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:13.466864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:13.466864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:13.602495 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:13.610809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e049fa06-0757-4179-97e3-77cf275378ca tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.166384 Dec 13 23:07:13.611662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 414/800] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:13 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:14.628447 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:14.629061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:14.635553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:14.635998 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:14.636791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:14.637280 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:14.781001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:14.797431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ad391f6c-2ef9-4a47-9ed1-bd6cc695cae0 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.173002 Dec 13 23:07:14.807875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 387/801] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:14 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:15.815593 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:15.816872 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:15.824065 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:15.824553 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:15.825559 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:15.825999 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:15.973228 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:15.982290 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-66fc51e0-edfb-4bdc-94c3-0389727db9e4 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.170775 Dec 13 23:07:15.983538 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 415/802] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:15 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:17.000144 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:17.001464 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:17.008833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:17.009273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:17.010101 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:17.010527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:17.168891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:17.179737 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-25a757e0-16ef-40a7-88f4-7a6acbb0213b tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.183762 Dec 13 23:07:17.180746 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 388/803] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:16 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:18.196540 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:18.197296 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:18.204908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:18.205630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:18.206602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:18.207193 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:18.353547 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:18.365232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d446a112-e9d9-4971-b368-e3f5b1b0369a tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.172365 Dec 13 23:07:18.366327 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 416/804] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:18 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:19.382945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:19.383858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:19.390489 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:19.390941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:19.391725 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:19.392151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:19.570757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:19.578708 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-25600997-726f-445f-8d76-5159c5e2c3b3 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.199437 Dec 13 23:07:19.579281 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 389/805] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:19 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:20.598501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:20.600320 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:20.610674 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:20.611664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:20.612929 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:20.613708 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:20.829874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:20.839071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f2ade89f-e0db-4d9c-8d2f-202078a01f92 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1521 microversion: 2.1 time: 0.246367 Dec 13 23:07:20.842035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 417/806] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:20 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:21.351285 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-29fcc2c7-d83c-42b0-bafb-b2bb67e8d276 req-cb38acdf-6dcd-4432-b9e8-2fc7be1f43d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f930f2d2-ece8-408b-aad2-fcb48bac226d", "name": "network-vif-deleted", "tag": "ceceea56-a83b-49e0-812f-5e242b04cd78"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:21.353519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:07:21.353519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:07:21.362988 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-29fcc2c7-d83c-42b0-bafb-b2bb67e8d276 req-cb38acdf-6dcd-4432-b9e8-2fc7be1f43d1 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:21.363516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-29fcc2c7-d83c-42b0-bafb-b2bb67e8d276 req-cb38acdf-6dcd-4432-b9e8-2fc7be1f43d1 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:21.376916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-29fcc2c7-d83c-42b0-bafb-b2bb67e8d276 req-cb38acdf-6dcd-4432-b9e8-2fc7be1f43d1 service nova] Creating event network-vif-deleted:ceceea56-a83b-49e0-812f-5e242b04cd78 for instance f930f2d2-ece8-408b-aad2-fcb48bac226d on hv-cinder-79628 Dec 13 23:07:21.383490 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-29fcc2c7-d83c-42b0-bafb-b2bb67e8d276 req-cb38acdf-6dcd-4432-b9e8-2fc7be1f43d1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035656 Dec 13 23:07:21.388730 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 390/807] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:07:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:07:21.859693 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:21.866308 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:21.876821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:21.877820 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:21.878981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:21.879735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:21.926800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:21.927808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:21.928466 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lazy-loading 'fault' on Instance uuid f930f2d2-ece8-408b-aad2-fcb48bac226d {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:07:21.986905 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b353b88c68b4f13809be4cf726facd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78a3c42585545bcb350232445d77600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:21.995434 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-acc728cd-a890-491e-8c9a-b4ba67014954 tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 200 len: 1311 microversion: 2.1 time: 0.140548 Dec 13 23:07:21.996749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 418/808] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:21 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:23.014119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:23.015013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] [instance: f930f2d2-ece8-408b-aad2-fcb48bac226d] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:23.021319 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:23.022043 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:23.023051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:23.023567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:23.037595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] HTTP exception thrown: Instance f930f2d2-ece8-408b-aad2-fcb48bac226d could not be found. Dec 13 23:07:23.038396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] Returning 404 to user: Instance f930f2d2-ece8-408b-aad2-fcb48bac226d could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:07:23.039433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9ac0093f-c8fe-4682-a2d0-b1c8983b443e tempest-ServerRescueNegativeTestJSON-874817884 tempest-ServerRescueNegativeTestJSON-874817884-project] 10.222.0.13 "GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d" status: 404 len: 111 microversion: 2.1 time: 0.029954 Dec 13 23:07:23.043679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 391/809] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:23 2021] GET /compute/v2.1/servers/f930f2d2-ece8-408b-aad2-fcb48bac226d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:07:41.283364 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5e08dd8b-f5ca-4822-a4f2-b2903c1ccced tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:41.283949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5e08dd8b-f5ca-4822-a4f2-b2903c1ccced tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:41.290524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e08dd8b-f5ca-4822-a4f2-b2903c1ccced tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:41.290968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e08dd8b-f5ca-4822-a4f2-b2903c1ccced tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:41.291744 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e08dd8b-f5ca-4822-a4f2-b2903c1ccced tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:41.292177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5e08dd8b-f5ca-4822-a4f2-b2903c1ccced tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:41.322497 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5e08dd8b-f5ca-4822-a4f2-b2903c1ccced tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments/ab85fd77-dc22-49c0-baaa-836d567cfeb2" status: 200 len: 194 microversion: 2.20 time: 0.045604 Dec 13 23:07:41.323064 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 419/810] 10.222.0.13 () {60 vars in 1453 bytes} [Mon Dec 13 23:07:41 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments/ab85fd77-dc22-49c0-baaa-836d567cfeb2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:07:41.385256 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:41.386128 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:41.393149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:41.393149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:41.393556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:41.393983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:41.473876 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lazy-loading 'services' on Instance uuid 168526af-2c4e-4e84-8b87-7f2e71d96e16 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:07:41.546925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-39d69621-c7e5-4c8d-912f-c397576a60f8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments/ab85fd77-dc22-49c0-baaa-836d567cfeb2" status: 202 len: 0 microversion: 2.20 time: 0.165180 Dec 13 23:07:41.547459 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 392/811] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Dec 13 23:07:41 2021] DELETE /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments/ab85fd77-dc22-49c0-baaa-836d567cfeb2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 13 23:07:41.556231 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b0c01246-9913-46fe-8c20-1c3a53eae489 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:41.557481 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b0c01246-9913-46fe-8c20-1c3a53eae489 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:41.564208 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0c01246-9913-46fe-8c20-1c3a53eae489 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:41.564805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0c01246-9913-46fe-8c20-1c3a53eae489 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:41.566035 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0c01246-9913-46fe-8c20-1c3a53eae489 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:41.566462 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b0c01246-9913-46fe-8c20-1c3a53eae489 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:41.598686 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b0c01246-9913-46fe-8c20-1c3a53eae489 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046247 Dec 13 23:07:41.599253 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 420/812] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Dec 13 23:07:41 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:07:42.611414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-08b4f0be-91f5-4978-930a-7d7f242d4155 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:42.612434 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-08b4f0be-91f5-4978-930a-7d7f242d4155 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:42.618693 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-08b4f0be-91f5-4978-930a-7d7f242d4155 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:42.619223 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-08b4f0be-91f5-4978-930a-7d7f242d4155 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:42.620176 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-08b4f0be-91f5-4978-930a-7d7f242d4155 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:42.620718 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-08b4f0be-91f5-4978-930a-7d7f242d4155 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:42.650444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-08b4f0be-91f5-4978-930a-7d7f242d4155 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043617 Dec 13 23:07:42.651094 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 393/813] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Dec 13 23:07:42 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:42.708582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:42.709093 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:42.715270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:42.715742 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:42.716505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:42.716932 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:42.742614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:07:42.824211 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3a481595-aac9-41e4-8f26-e044b21dc697 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 204 len: 0 microversion: 2.20 time: 0.118932 Dec 13 23:07:42.825067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 421/814] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Dec 13 23:07:42 2021] DELETE /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 23:07:42.835225 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:42.835837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:42.842670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:42.843113 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:42.844053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:42.844485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:42.980847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:42.988832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:42.990355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:42.991515 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-df7e0179-2bb1-4dc4-a8bc-6da54ff55ec6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.161436 Dec 13 23:07:42.992066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 394/815] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:42 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:44.012020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:44.012703 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:44.019706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:44.020244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:44.021032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:44.021573 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:44.171761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:44.183737 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:44.186706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:44.187864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-eaf20590-a9f8-46c6-8313-417d2c1785ed tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1721 microversion: 2.20 time: 0.180109 Dec 13 23:07:44.188478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 422/816] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:44 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:45.206886 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:45.207461 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:45.214197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:45.214572 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:45.215389 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:45.215799 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:45.285629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:45.294783 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:45.296714 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:45.301564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0b58eecc-ac8d-4860-9193-a4ec31e5cde7 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1655 microversion: 2.20 time: 0.095869 Dec 13 23:07:45.303487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 395/817] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:45 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1655 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:45.352253 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-cf08a5ed-ea74-4caf-a050-7436f8899ff4 req-df5f3836-dcbd-4b58-b7fc-f5acb3f2fe46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168526af-2c4e-4e84-8b87-7f2e71d96e16", "name": "network-vif-deleted", "tag": "ef742767-361d-4046-8bd3-5b8f1c34e632"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:45.353805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:07:45.353805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:07:45.362529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-cf08a5ed-ea74-4caf-a050-7436f8899ff4 req-df5f3836-dcbd-4b58-b7fc-f5acb3f2fe46 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:45.363295 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-cf08a5ed-ea74-4caf-a050-7436f8899ff4 req-df5f3836-dcbd-4b58-b7fc-f5acb3f2fe46 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:45.375008 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-cf08a5ed-ea74-4caf-a050-7436f8899ff4 req-df5f3836-dcbd-4b58-b7fc-f5acb3f2fe46 service nova] Creating event network-vif-deleted:ef742767-361d-4046-8bd3-5b8f1c34e632 for instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 on hv-cinder-79628 Dec 13 23:07:45.380175 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-cf08a5ed-ea74-4caf-a050-7436f8899ff4 req-df5f3836-dcbd-4b58-b7fc-f5acb3f2fe46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031844 Dec 13 23:07:45.380957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 423/818] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:07:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:07:46.320333 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:46.321059 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:46.327825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:46.328250 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:46.329043 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:46.329519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:46.397786 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:46.406358 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:46.407825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:46.408970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5538ba07-5f98-41fd-ac2a-6536c3902699 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1366 microversion: 2.20 time: 0.092558 Dec 13 23:07:46.409572 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 396/819] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:46 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:47.429818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:47.431637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:47.438961 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:47.439409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:47.440623 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:47.441375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:47.507705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:47.519217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:47.520958 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:47.522155 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-68c2b7a5-6c63-4fc8-a69b-99576ac5f955 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 200 len: 1366 microversion: 2.20 time: 0.098062 Dec 13 23:07:47.522732 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 424/820] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:47 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:47.887583 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4917af85-c3ea-4f9d-b90f-ee219bce6eee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:47.888491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4917af85-c3ea-4f9d-b90f-ee219bce6eee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:47.895159 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4917af85-c3ea-4f9d-b90f-ee219bce6eee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:47.895605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4917af85-c3ea-4f9d-b90f-ee219bce6eee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:47.896420 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4917af85-c3ea-4f9d-b90f-ee219bce6eee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:47.896853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4917af85-c3ea-4f9d-b90f-ee219bce6eee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:47.927746 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4917af85-c3ea-4f9d-b90f-ee219bce6eee tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043967 Dec 13 23:07:47.928562 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 397/821] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:07:47 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:07:47.986036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:47.986511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:47.993004 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:47.993513 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:47.994297 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:47.994739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:48.022310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:07:48.120246 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0b15e139-8897-45e7-949c-89f7e8b2d038 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 204 len: 0 microversion: 2.1 time: 0.137494 Dec 13 23:07:48.120859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 425/822] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:07:47 2021] DELETE /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:07:48.129528 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:48.130509 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:48.136893 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:48.137449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:48.138446 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:48.139100 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:48.291012 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:48.299551 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-be70dc78-0411-4bcd-9e63-2744e2cb80a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1672 microversion: 2.1 time: 0.173961 Dec 13 23:07:48.301023 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 398/823] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:48 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:48.543941 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:48.544718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:48.553197 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:48.553757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:48.554741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:48.555274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:48.571528 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] HTTP exception thrown: Instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 could not be found. Dec 13 23:07:48.572104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Returning 404 to user: Instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:07:48.572907 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1f161561-9689-49e0-bb06-522225f81507 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 404 len: 111 microversion: 2.20 time: 0.034323 Dec 13 23:07:48.573468 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 426/824] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:48 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:07:48.583383 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e8568fb1-e829-4627-bd02-30f133d5fb9f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '.version_select at 0x7f039a0e8c10>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:48.609996 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e8568fb1-e829-4627-bd02-30f133d5fb9f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362271203" status: 204 len: 0 microversion: 2.20 time: 0.030230 Dec 13 23:07:48.610689 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 399/825] 10.222.0.13 () {60 vars in 1258 bytes} [Mon Dec 13 23:07:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362271203 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 23:07:49.285158 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-75cc3740-7418-4ae5-90af-08681cbb0bcb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'create', calling method: .version_select at 0x7f039a0ed550>, body: {"keypair": {"name": "tempest-keypair-451469398"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:49.301279 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-75cc3740-7418-4ae5-90af-08681cbb0bcb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:07:49.305666 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-75cc3740-7418-4ae5-90af-08681cbb0bcb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for user 9aa225c572d14800b77943c1902833b0 and project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:07:49.317725 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:49.318413 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:49.325318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:49.325787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:49.326560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:49.326984 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:49.457829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:49.465582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a65d1d7c-2e16-4fff-9a67-92f4a129f824 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1672 microversion: 2.1 time: 0.151945 Dec 13 23:07:49.466112 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 400/826] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:49 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:49.532261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-75cc3740-7418-4ae5-90af-08681cbb0bcb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:07:49.538219 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-75cc3740-7418-4ae5-90af-08681cbb0bcb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for user 9aa225c572d14800b77943c1902833b0 and project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:07:49.551882 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-75cc3740-7418-4ae5-90af-08681cbb0bcb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.272003 Dec 13 23:07:49.552490 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 427/827] 10.222.0.13 () {62 vars in 1198 bytes} [Mon Dec 13 23:07:49 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 273 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 13 23:07:50.482417 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:50.483056 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:50.489756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:50.490195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:50.493297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:50.493735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:50.629103 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:50.637500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3646d7ed-c7a1-4c51-bd47-71e52c10af20 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1672 microversion: 2.1 time: 0.158733 Dec 13 23:07:50.638041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 401/828] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:50 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:50.850505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-78223411", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a89e1473-8054-486c-b303-1d4dde50db3c"}], "security_groups": [{"name": "tempest-securitygroup--1215138238"}], "key_name": "tempest-keypair-451469398", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:50.954016 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] validate_networks() for [('a89e1473-8054-486c-b303-1d4dde50db3c', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:07:51.327233 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:07:51.327694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:07:51.328201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:07:51.328620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:07:51.329028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:07:51.338919 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:51.339359 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:51.340192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:51.340624 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:51.358296 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:07:51.363016 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Getting quotas for user 9aa225c572d14800b77943c1902833b0 and project ff275d4e81c547e4b1d09435f41a51a6. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:07:51.375330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:07:51.377698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:07:51.425995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-14d7b507-5f1b-492e-a799-193528c2683f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.579757 Dec 13 23:07:51.426650 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 428/829] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Dec 13 23:07:50 2021] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 13 23:07:51.436817 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f75f43a8-b472-4637-889a-b0539d4d40f3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:51.437453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f75f43a8-b472-4637-889a-b0539d4d40f3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:51.507222 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f75f43a8-b472-4637-889a-b0539d4d40f3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:51.519462 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f75f43a8-b472-4637-889a-b0539d4d40f3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:51.521206 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f75f43a8-b472-4637-889a-b0539d4d40f3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:51.522530 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f75f43a8-b472-4637-889a-b0539d4d40f3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1279 microversion: 2.20 time: 0.089341 Dec 13 23:07:51.523123 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 402/830] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:51 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:51.654630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:51.655249 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:51.662173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:51.662704 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:51.663505 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:51.663944 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:52.154830 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:52.162698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-365ca5f8-9e15-48c3-807c-5baf07be0225 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1672 microversion: 2.1 time: 0.511779 Dec 13 23:07:52.163266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 429/831] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:51 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1672 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:52.540248 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:52.540893 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:52.547913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:52.548357 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:52.549117 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:52.549603 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:52.643481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:52.652614 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:52.654163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:52.655568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ea98eb1b-065e-4010-bb5d-4bca92ddf776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1337 microversion: 2.20 time: 0.118964 Dec 13 23:07:52.656342 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 403/832] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:52 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1337 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:52.918528 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-7217f4d2-4893-47a4-8943-b5e6cfe2a67b req-d1c2d4a6-e1d5-4e57-9e17-8904722d6e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8b680f-031a-4c92-b62f-cf4069ffec8f", "name": "network-vif-deleted", "tag": "80a67b49-708c-4b7f-8b08-ac990fa86f9e"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:52.920157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:07:52.920157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:07:52.939683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7217f4d2-4893-47a4-8943-b5e6cfe2a67b req-d1c2d4a6-e1d5-4e57-9e17-8904722d6e77 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:52.940128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-7217f4d2-4893-47a4-8943-b5e6cfe2a67b req-d1c2d4a6-e1d5-4e57-9e17-8904722d6e77 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:52.962065 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-7217f4d2-4893-47a4-8943-b5e6cfe2a67b req-d1c2d4a6-e1d5-4e57-9e17-8904722d6e77 service nova] Creating event network-vif-deleted:80a67b49-708c-4b7f-8b08-ac990fa86f9e for instance ff8b680f-031a-4c92-b62f-cf4069ffec8f on hv-cinder-79628 Dec 13 23:07:52.968501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-7217f4d2-4893-47a4-8943-b5e6cfe2a67b req-d1c2d4a6-e1d5-4e57-9e17-8904722d6e77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053831 Dec 13 23:07:52.969120 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 430/833] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:07:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:07:53.180842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:53.181744 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:53.188062 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:53.188564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:53.189657 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:53.190151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:53.266299 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:53.273996 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f3631819-0cbd-46be-8cd0-f6adf6445bd8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1605 microversion: 2.1 time: 0.097241 Dec 13 23:07:53.274500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 404/834] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:53 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:53.676450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:53.677145 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:53.684278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:53.684841 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:53.685821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:53.686259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:53.825464 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:53.833721 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:53.835286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:53.836383 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4c55deb1-ed79-4b7f-8d4d-20a355f82f8c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.164831 Dec 13 23:07:53.837111 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 431/835] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:53 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:54.294990 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:54.295919 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:54.305440 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:54.305908 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:54.306727 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:54.307160 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:54.367887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:54.375505 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c358fa7f-6a79-4c1f-836a-7ceb89f211be tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1322 microversion: 2.1 time: 0.086207 Dec 13 23:07:54.376067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 405/836] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:54 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:54.859690 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:54.861395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:54.870353 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:54.870798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:54.871580 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:54.872007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:55.011879 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:55.020135 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:55.021713 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:55.022816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fd43b1ef-00cb-4d18-b415-a9c191326be4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.170366 Dec 13 23:07:55.023369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 432/837] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:54 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:55.392401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:55.393629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:55.402156 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:55.402617 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:55.403632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:55.404079 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:55.435875 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:55.436866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:55.437537 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lazy-loading 'fault' on Instance uuid ff8b680f-031a-4c92-b62f-cf4069ffec8f {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:07:55.518120 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:55.525930 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-255bb2d8-2243-4e1b-b655-272aafe60593 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 200 len: 1327 microversion: 2.1 time: 0.137212 Dec 13 23:07:55.526508 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 406/838] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:55 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:07:55.956262 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-d57bc37a-8914-47f3-a158-ddd5197ac9da req-853511cf-fce7-491c-bad5-07d9f37137e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fdf52d-3f52-4676-8602-74d204bfc44a", "tag": "0a5e01cf-66ab-49f7-9779-2dc2d108f971"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:55.958583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:07:55.958583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:07:55.975243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-d57bc37a-8914-47f3-a158-ddd5197ac9da req-853511cf-fce7-491c-bad5-07d9f37137e9 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:55.975690 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-d57bc37a-8914-47f3-a158-ddd5197ac9da req-853511cf-fce7-491c-bad5-07d9f37137e9 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:55.987632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-d57bc37a-8914-47f3-a158-ddd5197ac9da req-853511cf-fce7-491c-bad5-07d9f37137e9 service nova] Creating event network-changed:0a5e01cf-66ab-49f7-9779-2dc2d108f971 for instance 94fdf52d-3f52-4676-8602-74d204bfc44a on hv-cinder-79628 Dec 13 23:07:55.992459 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-d57bc37a-8914-47f3-a158-ddd5197ac9da req-853511cf-fce7-491c-bad5-07d9f37137e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040017 Dec 13 23:07:55.993085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 433/839] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:07:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:07:56.043276 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:56.043883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:56.050066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:56.050855 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:56.051865 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:56.052302 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:56.258186 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:56.266596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:56.268104 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:56.269242 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-059ff594-36b8-49f4-b61a-7ee878f29bae tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.231821 Dec 13 23:07:56.269823 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 407/840] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:56 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:56.544085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:56.544778 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:56.551554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:56.552403 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:56.553709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:56.554319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:56.567889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] HTTP exception thrown: Instance ff8b680f-031a-4c92-b62f-cf4069ffec8f could not be found. Dec 13 23:07:56.568540 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Returning 404 to user: Instance ff8b680f-031a-4c92-b62f-cf4069ffec8f could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:07:56.570155 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cd073447-3554-4833-be31-851bfa003d30 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 404 len: 111 microversion: 2.1 time: 0.029893 Dec 13 23:07:56.573886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 434/841] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:07:56 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:07:56.578584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-de13ecfa-50ba-4b65-b1d5-a5b4d061d008 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '.version_select at 0x7f039a0ad670>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:56.598965 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-de13ecfa-50ba-4b65-b1d5-a5b4d061d008 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368039692" status: 202 len: 0 microversion: 2.1 time: 0.023934 Dec 13 23:07:56.599690 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 408/842] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Dec 13 23:07:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368039692 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:07:57.287484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:57.288585 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:57.295241 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:57.295699 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:57.296486 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:57.296927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:57.539271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-05421acb-93e5-4ebc-82c8-0cd98d4868c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'create', calling method: .version_select at 0x7f039a0c2940>, body: {"keypair": {"name": "tempest-keypair-266308672"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:57.553941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-05421acb-93e5-4ebc-82c8-0cd98d4868c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:07:57.557904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-05421acb-93e5-4ebc-82c8-0cd98d4868c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for user 03d43744f4884b27a0b5144142ca41bd and project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:07:57.619069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:57.627278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:57.628748 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:57.629880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a9b1172-977d-40d0-a269-acc2e8a21b34 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.346285 Dec 13 23:07:57.630479 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 435/843] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:57 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:57.956940 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-05421acb-93e5-4ebc-82c8-0cd98d4868c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:07:57.962102 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-05421acb-93e5-4ebc-82c8-0cd98d4868c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for user 03d43744f4884b27a0b5144142ca41bd and project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'key_pairs'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:07:57.978509 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-05421acb-93e5-4ebc-82c8-0cd98d4868c0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.443212 Dec 13 23:07:57.979428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 409/844] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Dec 13 23:07:57 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:07:58.648309 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:58.648906 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:58.655336 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:58.655779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:58.656548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:58.656973 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:58.794963 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:58.803632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:58.805175 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:07:58.806387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-534a8431-b46b-41fb-bab0-3dff6675218b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.162030 Dec 13 23:07:58.807024 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 436/845] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:58 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:07:59.345963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1117331297", "imageRef": "1e39f16d-57dd-483d-a38e-9e468b9f50c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b7619b6-4067-4576-9319-50cca228cd17"}], "security_groups": [{"name": "tempest-securitygroup--422677855"}], "key_name": "tempest-keypair-266308672", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:07:59.580435 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] validate_networks() for [('1b7619b6-4067-4576-9319-50cca228cd17', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:07:59.882200 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:07:59.882835 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:07:59.888706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:59.889143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:07:59.889967 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:07:59.890387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:00.034165 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:08:00.034589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:08:00.035064 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:08:00.035455 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:08:00.035865 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:08:00.045306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:00.045787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:00.046620 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:00.047020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:00.064858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:08:00.068876 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Getting quotas for user 03d43744f4884b27a0b5144142ca41bd and project 282a2d4b93ea4c3aa626e1676d2d8adf. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:08:00.072842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:00.079692 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:08:00.080928 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:00.082119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e39f16d-57dd-483d-a38e-9e468b9f50c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:08:00.082485 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:00.083584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1a5bc885-428f-408b-bbbc-978703c2fd4e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.263218 Dec 13 23:08:00.084172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 437/846] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:07:59 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:00.130289 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1141c4aa-4b4e-4bad-b7eb-d30a6fc4ec00 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.789352 Dec 13 23:08:00.130998 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 410/847] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:07:59 2021] POST /compute/v2.1/servers => generated 401 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:08:00.141095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c6c00892-f900-48f1-875d-20206b8e0b78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:00.141810 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c6c00892-f900-48f1-875d-20206b8e0b78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:00.195243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c6c00892-f900-48f1-875d-20206b8e0b78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:00.203429 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c6c00892-f900-48f1-875d-20206b8e0b78 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1237 microversion: 2.1 time: 0.066087 Dec 13 23:08:00.203999 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 438/848] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:00 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:01.102892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:01.103748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:01.110578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:01.111036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:01.111835 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:01.112637 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:01.220880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:01.221469 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:01.228802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:01.229244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:01.230058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:01.230492 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:01.586856 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:01.595404 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-9ec968b3-7a81-4b92-a023-045a11aca59b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1295 microversion: 2.1 time: 0.377906 Dec 13 23:08:01.596879 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 439/849] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:01 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1295 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:01.602437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-fa7e35b9-9602-4b88-9b67-b8b4528d6b5e req-13cf9596-04d7-4c86-9091-55dc65479fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fdf52d-3f52-4676-8602-74d204bfc44a", "name": "network-vif-plugged", "status": "completed", "tag": "0a5e01cf-66ab-49f7-9779-2dc2d108f971"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:01.604535 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:01.604535 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:08:01.612096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fa7e35b9-9602-4b88-9b67-b8b4528d6b5e req-13cf9596-04d7-4c86-9091-55dc65479fc4 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:01.612619 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-fa7e35b9-9602-4b88-9b67-b8b4528d6b5e req-13cf9596-04d7-4c86-9091-55dc65479fc4 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:01.619145 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:01.629060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:01.632638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:01.634049 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f8de9021-d0ec-40de-b8d3-6d1b06f6b431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.536022 Dec 13 23:08:01.638393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-fa7e35b9-9602-4b88-9b67-b8b4528d6b5e req-13cf9596-04d7-4c86-9091-55dc65479fc4 service nova] Creating event network-vif-plugged:0a5e01cf-66ab-49f7-9779-2dc2d108f971 for instance 94fdf52d-3f52-4676-8602-74d204bfc44a on hv-cinder-79628 Dec 13 23:08:01.643141 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-fa7e35b9-9602-4b88-9b67-b8b4528d6b5e req-13cf9596-04d7-4c86-9091-55dc65479fc4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044856 Dec 13 23:08:01.643746 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 440/850] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:01.647585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 411/851] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:01 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:02.612767 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:02.614537 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:02.621425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:02.622069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:02.623020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:02.623598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:02.654083 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:02.654840 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:02.664831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:02.665373 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:02.666208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:02.666642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:02.962831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:02.966631 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:02.975981 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:02.978580 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0cdcb9ec-0104-4a65-a246-7f0638ca0cf6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1362 microversion: 2.1 time: 0.367958 Dec 13 23:08:02.979656 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 441/852] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:02 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:02.980748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:02.983609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7921f9b4-dd3f-42eb-8f70-71215936394f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1405 microversion: 2.20 time: 0.333803 Dec 13 23:08:02.984648 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 412/853] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:02 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:08:03.039075 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-42e6349d-b6e4-4b3b-860a-83c6bb5efe63 req-081e07c8-bd1f-48c7-b288-1e3c6e9e30ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c075a0-798e-4b28-89fd-64a75cc94a11", "tag": "d9b70f80-b3ad-40cb-bf2c-629338553928"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:03.040938 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:03.040938 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:08:03.051440 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-42e6349d-b6e4-4b3b-860a-83c6bb5efe63 req-081e07c8-bd1f-48c7-b288-1e3c6e9e30ae service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:03.052010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-42e6349d-b6e4-4b3b-860a-83c6bb5efe63 req-081e07c8-bd1f-48c7-b288-1e3c6e9e30ae service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:03.067749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-42e6349d-b6e4-4b3b-860a-83c6bb5efe63 req-081e07c8-bd1f-48c7-b288-1e3c6e9e30ae service nova] Creating event network-changed:d9b70f80-b3ad-40cb-bf2c-629338553928 for instance e1c075a0-798e-4b28-89fd-64a75cc94a11 on hv-cinder-79628 Dec 13 23:08:03.074609 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-42e6349d-b6e4-4b3b-860a-83c6bb5efe63 req-081e07c8-bd1f-48c7-b288-1e3c6e9e30ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039618 Dec 13 23:08:03.076298 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 442/854] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:03.996646 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:03.997241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:04.004559 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:04.006081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:04.006214 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:04.007217 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:04.008160 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:04.008694 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:04.013113 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:04.013605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:04.014358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:04.014784 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:04.214898 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:04.221861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:04.231783 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-154c3dc5-7692-4f4a-9f1e-a51b027e1f27 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1362 microversion: 2.1 time: 0.238207 Dec 13 23:08:04.233228 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 413/855] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:03 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:04.236327 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:04.237832 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:04.238994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2cc1b36a-f0b1-4abe-af88-39fb4df083f9 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1596 microversion: 2.20 time: 0.238666 Dec 13 23:08:04.239530 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 443/856] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:03 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1596 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:04.258679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-319a49ef-d38d-4654-888c-f3bd61cab5e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:04.259173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-319a49ef-d38d-4654-888c-f3bd61cab5e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:04.265923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-319a49ef-d38d-4654-888c-f3bd61cab5e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:04.266491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-319a49ef-d38d-4654-888c-f3bd61cab5e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:04.267351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-319a49ef-d38d-4654-888c-f3bd61cab5e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:04.267833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-319a49ef-d38d-4654-888c-f3bd61cab5e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:04.356365 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-319a49ef-d38d-4654-888c-f3bd61cab5e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102921 Dec 13 23:08:04.356930 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 414/857] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Dec 13 23:08:04 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:05.249988 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:05.250554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:05.257722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:05.258167 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:05.258961 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:05.259386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:05.350104 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b33d5659-bd62-48de-aec1-6d83ac0d9266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:05.351210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b33d5659-bd62-48de-aec1-6d83ac0d9266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:05.358351 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b33d5659-bd62-48de-aec1-6d83ac0d9266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:05.358923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b33d5659-bd62-48de-aec1-6d83ac0d9266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:05.359708 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b33d5659-bd62-48de-aec1-6d83ac0d9266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:05.360133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b33d5659-bd62-48de-aec1-6d83ac0d9266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:05.402997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:05.410419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-89ddcf46-e33f-478a-b6ab-9b91ffff2cea tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1362 microversion: 2.1 time: 0.164296 Dec 13 23:08:05.410981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 444/858] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:05 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:05.415347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-12a03587-4e37-4022-92b9-533a8026344c req-18cf0be2-5311-448d-be4e-fd28d48570e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94fdf52d-3f52-4676-8602-74d204bfc44a", "tag": "0a5e01cf-66ab-49f7-9779-2dc2d108f971"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:05.417740 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:05.417740 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:08:05.424817 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-12a03587-4e37-4022-92b9-533a8026344c req-18cf0be2-5311-448d-be4e-fd28d48570e3 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:05.425626 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-12a03587-4e37-4022-92b9-533a8026344c req-18cf0be2-5311-448d-be4e-fd28d48570e3 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:05.436438 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-12a03587-4e37-4022-92b9-533a8026344c req-18cf0be2-5311-448d-be4e-fd28d48570e3 service nova] Creating event network-changed:0a5e01cf-66ab-49f7-9779-2dc2d108f971 for instance 94fdf52d-3f52-4676-8602-74d204bfc44a on hv-cinder-79628 Dec 13 23:08:05.441463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-12a03587-4e37-4022-92b9-533a8026344c req-18cf0be2-5311-448d-be4e-fd28d48570e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029315 Dec 13 23:08:05.442227 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 445/859] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:06.429600 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:06.430301 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:06.436942 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:06.437419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:06.438218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:06.438651 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:06.584816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:06.596429 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a1a18f6d-464d-4046-903b-38ad15a645d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1362 microversion: 2.1 time: 0.172234 Dec 13 23:08:06.597201 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 446/860] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:06 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:07.618095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:07.618939 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:07.625262 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:07.626089 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:07.627076 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:07.627662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:07.641702 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b33d5659-bd62-48de-aec1-6d83ac0d9266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 14 microversion: 2.20 time: 2.296017 Dec 13 23:08:07.645101 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 415/861] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:05 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 14 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:08:07.830630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:07.838674 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-aa9b2dca-71a8-4593-b302-6214765ddd37 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1362 microversion: 2.1 time: 0.227047 Dec 13 23:08:07.839844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 447/862] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:07 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:08.657599 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f0c3f7a1-21e2-41fd-8a9b-4227ee4b1b55 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:08.659202 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f0c3f7a1-21e2-41fd-8a9b-4227ee4b1b55 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:08.671270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f0c3f7a1-21e2-41fd-8a9b-4227ee4b1b55 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:08.672000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f0c3f7a1-21e2-41fd-8a9b-4227ee4b1b55 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:08.673325 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f0c3f7a1-21e2-41fd-8a9b-4227ee4b1b55 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:08.674095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f0c3f7a1-21e2-41fd-8a9b-4227ee4b1b55 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:08.734093 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f0c3f7a1-21e2-41fd-8a9b-4227ee4b1b55 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 14 microversion: 2.20 time: 0.083145 Dec 13 23:08:08.734734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 416/863] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:08 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:09.037246 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:09.037894 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:09.044430 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:09.044873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:09.045823 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:09.046257 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:09.181617 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:09.189022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-742936c9-906e-4933-a03c-a699a0357bf0 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1362 microversion: 2.1 time: 0.335605 Dec 13 23:08:09.189612 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 448/864] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:08 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:09.528409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-bcf578dc-03c2-44ee-a248-95cb60ffe1e7 req-95203376-8cb4-439c-9a8c-9a044688475e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c075a0-798e-4b28-89fd-64a75cc94a11", "name": "network-vif-plugged", "status": "completed", "tag": "d9b70f80-b3ad-40cb-bf2c-629338553928"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:09.530029 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:09.530029 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:08:09.538061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-bcf578dc-03c2-44ee-a248-95cb60ffe1e7 req-95203376-8cb4-439c-9a8c-9a044688475e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:09.538512 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-bcf578dc-03c2-44ee-a248-95cb60ffe1e7 req-95203376-8cb4-439c-9a8c-9a044688475e service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:09.549676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-bcf578dc-03c2-44ee-a248-95cb60ffe1e7 req-95203376-8cb4-439c-9a8c-9a044688475e service nova] Creating event network-vif-plugged:d9b70f80-b3ad-40cb-bf2c-629338553928 for instance e1c075a0-798e-4b28-89fd-64a75cc94a11 on hv-cinder-79628 Dec 13 23:08:09.554685 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-bcf578dc-03c2-44ee-a248-95cb60ffe1e7 req-95203376-8cb4-439c-9a8c-9a044688475e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030330 Dec 13 23:08:09.555451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 417/865] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:09.745980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1e3431e8-3911-4b44-a2cc-ded28ee1baca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:09.746956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1e3431e8-3911-4b44-a2cc-ded28ee1baca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:09.753268 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e3431e8-3911-4b44-a2cc-ded28ee1baca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:09.753745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e3431e8-3911-4b44-a2cc-ded28ee1baca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:09.754517 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e3431e8-3911-4b44-a2cc-ded28ee1baca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:09.754946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1e3431e8-3911-4b44-a2cc-ded28ee1baca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:10.009531 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1e3431e8-3911-4b44-a2cc-ded28ee1baca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 14 microversion: 2.20 time: 0.266222 Dec 13 23:08:10.010463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 449/866] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:09 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 14 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:10.206174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:10.206900 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:10.214130 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:10.214695 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:10.215464 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:10.215924 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:10.351265 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:10.359297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1ccd371e-efaf-4538-b64c-af64adf2c3cd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1362 microversion: 2.1 time: 0.157587 Dec 13 23:08:10.359865 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 418/867] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:10 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:11.023104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f1ca9665-d630-4fee-ad85-d04e913e5129 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:11.024090 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f1ca9665-d630-4fee-ad85-d04e913e5129 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:11.031109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1ca9665-d630-4fee-ad85-d04e913e5129 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:11.031551 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1ca9665-d630-4fee-ad85-d04e913e5129 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:11.032314 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1ca9665-d630-4fee-ad85-d04e913e5129 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:11.032875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f1ca9665-d630-4fee-ad85-d04e913e5129 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:11.090763 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f1ca9665-d630-4fee-ad85-d04e913e5129 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 14 microversion: 2.20 time: 0.071715 Dec 13 23:08:11.091389 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 450/868] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:11 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:08:11.375678 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:11.376562 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:11.382640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:11.383135 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:11.383921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:11.384363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:11.516570 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:11.524115 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-21bcc2be-9cbe-412a-a66e-f8383911cff3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1548 microversion: 2.1 time: 0.152046 Dec 13 23:08:11.524676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 419/869] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:11 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:11.545482 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c19a1f23-a436-4a99-b1f3-ec63c7d868f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:11.546067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c19a1f23-a436-4a99-b1f3-ec63c7d868f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:11.555694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c19a1f23-a436-4a99-b1f3-ec63c7d868f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:11.556378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c19a1f23-a436-4a99-b1f3-ec63c7d868f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:11.557562 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c19a1f23-a436-4a99-b1f3-ec63c7d868f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:11.557997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c19a1f23-a436-4a99-b1f3-ec63c7d868f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:11.639778 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c19a1f23-a436-4a99-b1f3-ec63c7d868f8 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099269 Dec 13 23:08:11.640370 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 451/870] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Dec 13 23:08:11 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:12.102595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-47d44b57-7ba1-42bb-9b7c-f66977c083e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:12.103609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-47d44b57-7ba1-42bb-9b7c-f66977c083e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:12.110465 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47d44b57-7ba1-42bb-9b7c-f66977c083e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:12.110910 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47d44b57-7ba1-42bb-9b7c-f66977c083e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:12.111687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47d44b57-7ba1-42bb-9b7c-f66977c083e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:12.112115 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-47d44b57-7ba1-42bb-9b7c-f66977c083e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:12.171521 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-47d44b57-7ba1-42bb-9b7c-f66977c083e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 14 microversion: 2.20 time: 0.073054 Dec 13 23:08:12.172588 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 420/871] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:12 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:12.908193 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1f635c89-c642-4ac5-97be-d4034b7b2871 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:12.911405 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-38363fc5-49f6-4dba-aeeb-cd951eec4161 req-069898bd-fa46-469a-9a04-1bc579377a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c075a0-798e-4b28-89fd-64a75cc94a11", "tag": "d9b70f80-b3ad-40cb-bf2c-629338553928"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:12.912914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:12.912914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:08:12.918294 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1f635c89-c642-4ac5-97be-d4034b7b2871 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:12.926311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-38363fc5-49f6-4dba-aeeb-cd951eec4161 req-069898bd-fa46-469a-9a04-1bc579377a9d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:12.926753 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-38363fc5-49f6-4dba-aeeb-cd951eec4161 req-069898bd-fa46-469a-9a04-1bc579377a9d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:12.932961 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f635c89-c642-4ac5-97be-d4034b7b2871 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:12.933425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f635c89-c642-4ac5-97be-d4034b7b2871 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:12.934255 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f635c89-c642-4ac5-97be-d4034b7b2871 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:12.934692 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1f635c89-c642-4ac5-97be-d4034b7b2871 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:12.960423 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-38363fc5-49f6-4dba-aeeb-cd951eec4161 req-069898bd-fa46-469a-9a04-1bc579377a9d service nova] Creating event network-changed:d9b70f80-b3ad-40cb-bf2c-629338553928 for instance e1c075a0-798e-4b28-89fd-64a75cc94a11 on hv-cinder-79628 Dec 13 23:08:12.967787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-38363fc5-49f6-4dba-aeeb-cd951eec4161 req-069898bd-fa46-469a-9a04-1bc579377a9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063778 Dec 13 23:08:12.969303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 421/872] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:13.023203 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1f635c89-c642-4ac5-97be-d4034b7b2871 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.121632 Dec 13 23:08:13.027992 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 452/873] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:12 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:13.184688 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1edacdb4-6f7d-4a4e-9ad1-6f6d7fe503f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:13.186161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1edacdb4-6f7d-4a4e-9ad1-6f6d7fe503f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:13.192540 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1edacdb4-6f7d-4a4e-9ad1-6f6d7fe503f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:13.192985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1edacdb4-6f7d-4a4e-9ad1-6f6d7fe503f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:13.193800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1edacdb4-6f7d-4a4e-9ad1-6f6d7fe503f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:13.194431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1edacdb4-6f7d-4a4e-9ad1-6f6d7fe503f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:13.266395 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1edacdb4-6f7d-4a4e-9ad1-6f6d7fe503f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 14 microversion: 2.20 time: 0.086050 Dec 13 23:08:13.267578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 422/874] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:13 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:14.036687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b4a1b6f2-bf12-4403-9095-1b403c77d950 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:14.037835 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b4a1b6f2-bf12-4403-9095-1b403c77d950 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:14.046698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4a1b6f2-bf12-4403-9095-1b403c77d950 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:14.047385 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4a1b6f2-bf12-4403-9095-1b403c77d950 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:14.048192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4a1b6f2-bf12-4403-9095-1b403c77d950 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:14.048622 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b4a1b6f2-bf12-4403-9095-1b403c77d950 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:14.132384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b4a1b6f2-bf12-4403-9095-1b403c77d950 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.099664 Dec 13 23:08:14.136378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 453/875] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:14 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:14.279793 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-66f348be-d389-4e01-88c3-d083a708e2a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:14.281089 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-66f348be-d389-4e01-88c3-d083a708e2a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:14.291327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66f348be-d389-4e01-88c3-d083a708e2a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:14.291857 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66f348be-d389-4e01-88c3-d083a708e2a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:14.292747 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66f348be-d389-4e01-88c3-d083a708e2a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:14.293238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-66f348be-d389-4e01-88c3-d083a708e2a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:14.368029 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-66f348be-d389-4e01-88c3-d083a708e2a8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 14 microversion: 2.20 time: 0.093647 Dec 13 23:08:14.368786 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 423/876] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:14 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:15.145941 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a9f2657f-5735-43d0-9215-3eb84bdd1ca5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:15.147815 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a9f2657f-5735-43d0-9215-3eb84bdd1ca5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:15.164689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9f2657f-5735-43d0-9215-3eb84bdd1ca5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:15.165502 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9f2657f-5735-43d0-9215-3eb84bdd1ca5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:15.166606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9f2657f-5735-43d0-9215-3eb84bdd1ca5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:15.167187 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a9f2657f-5735-43d0-9215-3eb84bdd1ca5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:15.240935 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a9f2657f-5735-43d0-9215-3eb84bdd1ca5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.100504 Dec 13 23:08:15.242129 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 454/877] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:15 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:15.379774 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-53f4706f-1abc-4ae3-80ef-0a80c8da6d0a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:15.382146 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-53f4706f-1abc-4ae3-80ef-0a80c8da6d0a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:15.394516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-53f4706f-1abc-4ae3-80ef-0a80c8da6d0a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:15.395712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-53f4706f-1abc-4ae3-80ef-0a80c8da6d0a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:15.396754 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-53f4706f-1abc-4ae3-80ef-0a80c8da6d0a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:15.398226 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-53f4706f-1abc-4ae3-80ef-0a80c8da6d0a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:15.466766 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-53f4706f-1abc-4ae3-80ef-0a80c8da6d0a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 6451 microversion: 2.20 time: 0.091211 Dec 13 23:08:15.468492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 424/878] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:15 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 6451 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:16.253592 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8598337b-6a26-43b5-9051-994e92af021a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:16.254687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8598337b-6a26-43b5-9051-994e92af021a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:16.264103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8598337b-6a26-43b5-9051-994e92af021a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:16.264804 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8598337b-6a26-43b5-9051-994e92af021a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:16.265838 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8598337b-6a26-43b5-9051-994e92af021a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:16.266291 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8598337b-6a26-43b5-9051-994e92af021a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:16.333583 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8598337b-6a26-43b5-9051-994e92af021a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.083976 Dec 13 23:08:16.337261 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 455/879] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:16 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:16.479768 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-20efd240-6223-48f3-a4e9-6552b7d7244a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:16.480769 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-20efd240-6223-48f3-a4e9-6552b7d7244a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:16.487525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-20efd240-6223-48f3-a4e9-6552b7d7244a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:16.488109 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-20efd240-6223-48f3-a4e9-6552b7d7244a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:16.489408 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-20efd240-6223-48f3-a4e9-6552b7d7244a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:16.489665 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-20efd240-6223-48f3-a4e9-6552b7d7244a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:16.560506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-20efd240-6223-48f3-a4e9-6552b7d7244a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 15025 microversion: 2.20 time: 0.085339 Dec 13 23:08:16.564800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 425/880] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:16 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 15025 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:17.352698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d0c059b1-4195-4e16-b361-562fc3ac07e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:17.353814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d0c059b1-4195-4e16-b361-562fc3ac07e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:17.361614 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0c059b1-4195-4e16-b361-562fc3ac07e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:17.362707 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0c059b1-4195-4e16-b361-562fc3ac07e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:17.363796 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0c059b1-4195-4e16-b361-562fc3ac07e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:17.364380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d0c059b1-4195-4e16-b361-562fc3ac07e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:17.441514 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d0c059b1-4195-4e16-b361-562fc3ac07e6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.096787 Dec 13 23:08:17.442161 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 456/881] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:17 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:17.572874 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-fbd0e8f2-8e41-4d9c-81f8-55cc5c6a4d26 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:17.573965 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-fbd0e8f2-8e41-4d9c-81f8-55cc5c6a4d26 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:17.581604 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fbd0e8f2-8e41-4d9c-81f8-55cc5c6a4d26 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:17.582364 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fbd0e8f2-8e41-4d9c-81f8-55cc5c6a4d26 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:17.583588 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fbd0e8f2-8e41-4d9c-81f8-55cc5c6a4d26 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:17.583851 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fbd0e8f2-8e41-4d9c-81f8-55cc5c6a4d26 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:17.664847 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-fbd0e8f2-8e41-4d9c-81f8-55cc5c6a4d26 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 18608 microversion: 2.20 time: 0.096014 Dec 13 23:08:17.666837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 426/882] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:17 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 18608 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:18.452844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bfc73a4a-997d-45d6-898c-a3644b410200 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:18.454129 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bfc73a4a-997d-45d6-898c-a3644b410200 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:18.467079 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bfc73a4a-997d-45d6-898c-a3644b410200 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:18.469990 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bfc73a4a-997d-45d6-898c-a3644b410200 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:18.470798 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bfc73a4a-997d-45d6-898c-a3644b410200 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:18.471229 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bfc73a4a-997d-45d6-898c-a3644b410200 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:18.535177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bfc73a4a-997d-45d6-898c-a3644b410200 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.086213 Dec 13 23:08:18.552121 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 457/883] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:18 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:18.677505 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a0e5b0d7-20cd-4da5-9305-49628addf358 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:18.686583 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a0e5b0d7-20cd-4da5-9305-49628addf358 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:18.694170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0e5b0d7-20cd-4da5-9305-49628addf358 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:18.695025 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0e5b0d7-20cd-4da5-9305-49628addf358 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:18.696320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0e5b0d7-20cd-4da5-9305-49628addf358 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:18.696753 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a0e5b0d7-20cd-4da5-9305-49628addf358 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:18.770782 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a0e5b0d7-20cd-4da5-9305-49628addf358 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 19893 microversion: 2.20 time: 0.097608 Dec 13 23:08:18.771536 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 427/884] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:18 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 19893 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:19.548079 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4cf1b291-b6b7-488b-aae3-b6c12eabe70f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:19.549752 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4cf1b291-b6b7-488b-aae3-b6c12eabe70f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:19.562911 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cf1b291-b6b7-488b-aae3-b6c12eabe70f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:19.571827 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cf1b291-b6b7-488b-aae3-b6c12eabe70f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:19.572146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cf1b291-b6b7-488b-aae3-b6c12eabe70f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:19.572595 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4cf1b291-b6b7-488b-aae3-b6c12eabe70f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:19.658511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4cf1b291-b6b7-488b-aae3-b6c12eabe70f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.114391 Dec 13 23:08:19.659169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 458/885] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:19 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:19.787393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cec4bacf-212e-4bb1-998e-002892dfa795 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:19.789798 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cec4bacf-212e-4bb1-998e-002892dfa795 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:19.798476 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cec4bacf-212e-4bb1-998e-002892dfa795 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:19.799440 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cec4bacf-212e-4bb1-998e-002892dfa795 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:19.800811 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cec4bacf-212e-4bb1-998e-002892dfa795 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:19.801497 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cec4bacf-212e-4bb1-998e-002892dfa795 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:19.892324 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cec4bacf-212e-4bb1-998e-002892dfa795 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 22716 microversion: 2.20 time: 0.108309 Dec 13 23:08:19.893951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 428/886] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:19 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 22716 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:20.670706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b5da75cc-6183-4801-a2c5-a498ebd4b595 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:20.672471 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b5da75cc-6183-4801-a2c5-a498ebd4b595 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:20.680422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b5da75cc-6183-4801-a2c5-a498ebd4b595 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:20.680851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b5da75cc-6183-4801-a2c5-a498ebd4b595 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:20.681941 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b5da75cc-6183-4801-a2c5-a498ebd4b595 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:20.682525 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b5da75cc-6183-4801-a2c5-a498ebd4b595 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:20.748240 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b5da75cc-6183-4801-a2c5-a498ebd4b595 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.081657 Dec 13 23:08:20.752882 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 459/887] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:20 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:08:20.904787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-93b129aa-db35-491b-8609-fd5da32a07a2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:20.906453 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-93b129aa-db35-491b-8609-fd5da32a07a2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:20.913814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93b129aa-db35-491b-8609-fd5da32a07a2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:20.914473 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93b129aa-db35-491b-8609-fd5da32a07a2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:20.915455 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93b129aa-db35-491b-8609-fd5da32a07a2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:20.915894 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93b129aa-db35-491b-8609-fd5da32a07a2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:21.007604 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-93b129aa-db35-491b-8609-fd5da32a07a2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 23804 microversion: 2.20 time: 0.106661 Dec 13 23:08:21.013259 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 429/888] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:20 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 23804 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:21.541819 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5b5ed68b-795b-45ee-8a68-7605badb6f06 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Action: 'create', calling method: .version_select at 0x7f039a090e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-757443627"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:21.557151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-5b5ed68b-795b-45ee-8a68-7605badb6f06 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:08:21.561224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-5b5ed68b-795b-45ee-8a68-7605badb6f06 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for user 33969662112e43f6a1c3dd76d70deca4 and project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:08:21.756232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-5b5ed68b-795b-45ee-8a68-7605badb6f06 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:08:21.760244 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-58878fab-321a-4cfc-8721-4619ff20f17f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:21.760427 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-5b5ed68b-795b-45ee-8a68-7605badb6f06 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for user 33969662112e43f6a1c3dd76d70deca4 and project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:08:21.761356 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-58878fab-321a-4cfc-8721-4619ff20f17f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:21.767970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58878fab-321a-4cfc-8721-4619ff20f17f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:21.768708 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58878fab-321a-4cfc-8721-4619ff20f17f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:21.769818 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58878fab-321a-4cfc-8721-4619ff20f17f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:21.770433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58878fab-321a-4cfc-8721-4619ff20f17f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:21.774214 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5b5ed68b-795b-45ee-8a68-7605badb6f06 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.401096 Dec 13 23:08:21.779434 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 460/889] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Dec 13 23:08:21 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:21.850687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-58878fab-321a-4cfc-8721-4619ff20f17f tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 14 microversion: 2.1 time: 0.094267 Dec 13 23:08:21.851374 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 430/890] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:21 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:08:22.020791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7e3bfa91-979a-462c-971d-042ada3a7683 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:22.021874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7e3bfa91-979a-462c-971d-042ada3a7683 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:22.028854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa91-979a-462c-971d-042ada3a7683 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:22.029606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa91-979a-462c-971d-042ada3a7683 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:22.030571 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa91-979a-462c-971d-042ada3a7683 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:22.031002 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa91-979a-462c-971d-042ada3a7683 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:22.111929 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7e3bfa91-979a-462c-971d-042ada3a7683 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 25465 microversion: 2.20 time: 0.095243 Dec 13 23:08:22.112869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 461/891] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:22 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 25465 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:22.862722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a7d5b95d-c4ec-409e-88df-613727340beb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:22.863713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a7d5b95d-c4ec-409e-88df-613727340beb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:22.888603 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a7d5b95d-c4ec-409e-88df-613727340beb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:22.889233 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a7d5b95d-c4ec-409e-88df-613727340beb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:22.892189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a7d5b95d-c4ec-409e-88df-613727340beb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:22.898144 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a7d5b95d-c4ec-409e-88df-613727340beb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:22.969988 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a7d5b95d-c4ec-409e-88df-613727340beb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 6451 microversion: 2.1 time: 0.111328 Dec 13 23:08:22.973207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 431/892] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:22 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 6451 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:23.130434 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d60ab062-1175-4186-b9d7-bf258b386f5b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:23.132043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d60ab062-1175-4186-b9d7-bf258b386f5b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:23.145863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d60ab062-1175-4186-b9d7-bf258b386f5b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:23.146759 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d60ab062-1175-4186-b9d7-bf258b386f5b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:23.147752 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d60ab062-1175-4186-b9d7-bf258b386f5b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:23.148378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d60ab062-1175-4186-b9d7-bf258b386f5b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:23.248206 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d60ab062-1175-4186-b9d7-bf258b386f5b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 26750 microversion: 2.20 time: 0.126714 Dec 13 23:08:23.250984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 462/893] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:23 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 26750 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:08:23.981022 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7e83248b-df91-42ba-a1bd-da789e68ee23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:23.982058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7e83248b-df91-42ba-a1bd-da789e68ee23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:23.989166 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e83248b-df91-42ba-a1bd-da789e68ee23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:23.989638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e83248b-df91-42ba-a1bd-da789e68ee23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:23.990420 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e83248b-df91-42ba-a1bd-da789e68ee23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:23.990843 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7e83248b-df91-42ba-a1bd-da789e68ee23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:24.071027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7e83248b-df91-42ba-a1bd-da789e68ee23 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 15025 microversion: 2.1 time: 0.094120 Dec 13 23:08:24.071675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 432/894] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:23 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 15025 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:24.262185 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5acad622-67f4-45b2-8b73-4bec663872ca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:24.263196 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5acad622-67f4-45b2-8b73-4bec663872ca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:24.270558 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5acad622-67f4-45b2-8b73-4bec663872ca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:24.271010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5acad622-67f4-45b2-8b73-4bec663872ca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:24.271808 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5acad622-67f4-45b2-8b73-4bec663872ca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:24.272245 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5acad622-67f4-45b2-8b73-4bec663872ca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:24.372577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5acad622-67f4-45b2-8b73-4bec663872ca tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 27509 microversion: 2.20 time: 0.114535 Dec 13 23:08:24.373242 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 463/895] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:24 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 27509 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:25.084741 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e717b5d3-2ef7-4646-bb4d-2b402f6f4248 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:25.086818 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e717b5d3-2ef7-4646-bb4d-2b402f6f4248 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:25.094280 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e717b5d3-2ef7-4646-bb4d-2b402f6f4248 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:25.095009 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e717b5d3-2ef7-4646-bb4d-2b402f6f4248 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:25.096073 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e717b5d3-2ef7-4646-bb4d-2b402f6f4248 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:25.096623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e717b5d3-2ef7-4646-bb4d-2b402f6f4248 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:25.192140 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e717b5d3-2ef7-4646-bb4d-2b402f6f4248 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 18305 microversion: 2.1 time: 0.113078 Dec 13 23:08:25.192794 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 433/896] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:25 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 18305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:25.385003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cdf6dae8-214b-4f23-a7ad-27e47126a5c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:25.386092 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cdf6dae8-214b-4f23-a7ad-27e47126a5c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:25.396745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdf6dae8-214b-4f23-a7ad-27e47126a5c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:25.399955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdf6dae8-214b-4f23-a7ad-27e47126a5c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:25.399955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdf6dae8-214b-4f23-a7ad-27e47126a5c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:25.399955 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cdf6dae8-214b-4f23-a7ad-27e47126a5c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:25.505531 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cdf6dae8-214b-4f23-a7ad-27e47126a5c2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 27824 microversion: 2.20 time: 0.124750 Dec 13 23:08:25.508209 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 464/897] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:25 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 27824 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:26.204673 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a05f1088-1f02-4483-91b9-7acf4867cf70 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:26.205723 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a05f1088-1f02-4483-91b9-7acf4867cf70 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:26.213017 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a05f1088-1f02-4483-91b9-7acf4867cf70 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:26.213523 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a05f1088-1f02-4483-91b9-7acf4867cf70 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:26.214462 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a05f1088-1f02-4483-91b9-7acf4867cf70 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:26.214903 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a05f1088-1f02-4483-91b9-7acf4867cf70 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:26.299809 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a05f1088-1f02-4483-91b9-7acf4867cf70 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 19096 microversion: 2.1 time: 0.098557 Dec 13 23:08:26.300924 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 434/898] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:26 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 19096 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:26.520708 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e9114c65-84bd-4a33-b6ea-048f0e21de35 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:26.521753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e9114c65-84bd-4a33-b6ea-048f0e21de35 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:26.528869 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9114c65-84bd-4a33-b6ea-048f0e21de35 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:26.529308 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9114c65-84bd-4a33-b6ea-048f0e21de35 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:26.530151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9114c65-84bd-4a33-b6ea-048f0e21de35 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:26.530574 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e9114c65-84bd-4a33-b6ea-048f0e21de35 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:26.611241 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e9114c65-84bd-4a33-b6ea-048f0e21de35 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28176 microversion: 2.20 time: 0.094483 Dec 13 23:08:26.611892 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 465/899] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:26 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28176 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:08:27.313563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-606c643c-f191-4e7f-8bc7-840fb4ed606a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:27.314590 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-606c643c-f191-4e7f-8bc7-840fb4ed606a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:27.321881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-606c643c-f191-4e7f-8bc7-840fb4ed606a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:27.322369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-606c643c-f191-4e7f-8bc7-840fb4ed606a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:27.323152 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-606c643c-f191-4e7f-8bc7-840fb4ed606a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:27.323576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-606c643c-f191-4e7f-8bc7-840fb4ed606a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:27.401129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-606c643c-f191-4e7f-8bc7-840fb4ed606a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 21513 microversion: 2.1 time: 0.090966 Dec 13 23:08:27.401825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 435/900] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:27 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 21513 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:27.624491 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5c0faaf3-9d1d-4097-9db0-6fe75ea70c99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:27.625514 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5c0faaf3-9d1d-4097-9db0-6fe75ea70c99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:27.633052 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c0faaf3-9d1d-4097-9db0-6fe75ea70c99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:27.633542 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c0faaf3-9d1d-4097-9db0-6fe75ea70c99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:27.634572 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c0faaf3-9d1d-4097-9db0-6fe75ea70c99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:27.635007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c0faaf3-9d1d-4097-9db0-6fe75ea70c99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:27.704063 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5c0faaf3-9d1d-4097-9db0-6fe75ea70c99 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28176 microversion: 2.20 time: 0.083892 Dec 13 23:08:27.704735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 466/901] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:27 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28176 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:28.415944 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-be4e63f3-036a-43fb-a5b5-334f59b685b2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:28.416946 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-be4e63f3-036a-43fb-a5b5-334f59b685b2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:28.427147 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be4e63f3-036a-43fb-a5b5-334f59b685b2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:28.427589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be4e63f3-036a-43fb-a5b5-334f59b685b2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:28.428376 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be4e63f3-036a-43fb-a5b5-334f59b685b2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:28.428806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-be4e63f3-036a-43fb-a5b5-334f59b685b2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:28.506146 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-be4e63f3-036a-43fb-a5b5-334f59b685b2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 22974 microversion: 2.1 time: 0.096036 Dec 13 23:08:28.506698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 436/902] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:28 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 22974 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:28.716949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1b4ee8ec-960f-4d0b-8705-33602e7ec994 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:28.718217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1b4ee8ec-960f-4d0b-8705-33602e7ec994 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:28.726135 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b4ee8ec-960f-4d0b-8705-33602e7ec994 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:28.726569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b4ee8ec-960f-4d0b-8705-33602e7ec994 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:28.727422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b4ee8ec-960f-4d0b-8705-33602e7ec994 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:28.727811 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b4ee8ec-960f-4d0b-8705-33602e7ec994 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:28.818471 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1b4ee8ec-960f-4d0b-8705-33602e7ec994 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28467 microversion: 2.20 time: 0.105339 Dec 13 23:08:28.819265 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 467/903] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:28 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28467 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:29.522370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a22d7ba1-9eeb-462d-9479-41c14894e508 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:29.523587 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a22d7ba1-9eeb-462d-9479-41c14894e508 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:29.531750 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a22d7ba1-9eeb-462d-9479-41c14894e508 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:29.532195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a22d7ba1-9eeb-462d-9479-41c14894e508 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:29.532962 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a22d7ba1-9eeb-462d-9479-41c14894e508 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:29.533386 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a22d7ba1-9eeb-462d-9479-41c14894e508 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:29.607365 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a22d7ba1-9eeb-462d-9479-41c14894e508 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 24277 microversion: 2.1 time: 0.091759 Dec 13 23:08:29.608014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 437/904] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:29 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 24277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:29.832517 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-be2f6af9-7062-4339-900b-91f99404043a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:29.834277 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-be2f6af9-7062-4339-900b-91f99404043a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:29.841671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be2f6af9-7062-4339-900b-91f99404043a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:29.842113 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be2f6af9-7062-4339-900b-91f99404043a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:29.843000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be2f6af9-7062-4339-900b-91f99404043a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:29.843431 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be2f6af9-7062-4339-900b-91f99404043a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:29.911358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-be2f6af9-7062-4339-900b-91f99404043a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28467 microversion: 2.20 time: 0.082512 Dec 13 23:08:29.912998 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 468/905] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:29 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28467 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:30.621127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5a8f3f52-907a-4ba9-a22b-75faa2abde4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:30.622567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5a8f3f52-907a-4ba9-a22b-75faa2abde4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:30.631506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a8f3f52-907a-4ba9-a22b-75faa2abde4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:30.631951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a8f3f52-907a-4ba9-a22b-75faa2abde4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:30.632744 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a8f3f52-907a-4ba9-a22b-75faa2abde4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:30.633178 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a8f3f52-907a-4ba9-a22b-75faa2abde4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:30.715355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5a8f3f52-907a-4ba9-a22b-75faa2abde4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 25837 microversion: 2.1 time: 0.099144 Dec 13 23:08:30.716073 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 438/906] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:30 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 25837 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:30.930810 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5b5d7507-6e75-4c2a-9ddb-7afdb47e9d2d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:30.932071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5b5d7507-6e75-4c2a-9ddb-7afdb47e9d2d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:30.940788 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b5d7507-6e75-4c2a-9ddb-7afdb47e9d2d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:30.941223 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b5d7507-6e75-4c2a-9ddb-7afdb47e9d2d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:30.942039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b5d7507-6e75-4c2a-9ddb-7afdb47e9d2d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:30.942467 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5b5d7507-6e75-4c2a-9ddb-7afdb47e9d2d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:31.020837 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5b5d7507-6e75-4c2a-9ddb-7afdb47e9d2d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28634 microversion: 2.20 time: 0.096622 Dec 13 23:08:31.021854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 469/907] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:30 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28634 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:31.728201 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-799d8a55-92e3-4ca4-93fb-3a1ffa5a68c6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:31.729480 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-799d8a55-92e3-4ca4-93fb-3a1ffa5a68c6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:31.737465 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-799d8a55-92e3-4ca4-93fb-3a1ffa5a68c6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:31.737913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-799d8a55-92e3-4ca4-93fb-3a1ffa5a68c6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:31.738711 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-799d8a55-92e3-4ca4-93fb-3a1ffa5a68c6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:31.739134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-799d8a55-92e3-4ca4-93fb-3a1ffa5a68c6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:31.834644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-799d8a55-92e3-4ca4-93fb-3a1ffa5a68c6 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 26823 microversion: 2.1 time: 0.110320 Dec 13 23:08:31.835276 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 439/908] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:31 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 26823 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:32.033984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b7d01066-1520-4383-bff1-fa77a49c8f6c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:32.034980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b7d01066-1520-4383-bff1-fa77a49c8f6c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:32.042335 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7d01066-1520-4383-bff1-fa77a49c8f6c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:32.042781 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7d01066-1520-4383-bff1-fa77a49c8f6c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:32.043556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7d01066-1520-4383-bff1-fa77a49c8f6c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:32.043987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7d01066-1520-4383-bff1-fa77a49c8f6c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:32.117002 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b7d01066-1520-4383-bff1-fa77a49c8f6c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28634 microversion: 2.20 time: 0.087026 Dec 13 23:08:32.117705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 470/909] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:32 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28634 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:32.848316 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-45dce7b3-60cf-43cd-9957-8d3306642a1a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:32.849318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-45dce7b3-60cf-43cd-9957-8d3306642a1a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:32.856455 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45dce7b3-60cf-43cd-9957-8d3306642a1a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:32.856897 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45dce7b3-60cf-43cd-9957-8d3306642a1a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:32.857706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45dce7b3-60cf-43cd-9957-8d3306642a1a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:32.858133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45dce7b3-60cf-43cd-9957-8d3306642a1a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:32.939765 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-45dce7b3-60cf-43cd-9957-8d3306642a1a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 27386 microversion: 2.1 time: 0.095323 Dec 13 23:08:32.940409 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 440/910] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:32 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 27386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:33.129738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7cc58243-aa82-432c-b0bd-5f37c62292bd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:33.130775 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7cc58243-aa82-432c-b0bd-5f37c62292bd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:33.138085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7cc58243-aa82-432c-b0bd-5f37c62292bd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:33.138543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7cc58243-aa82-432c-b0bd-5f37c62292bd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:33.139327 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7cc58243-aa82-432c-b0bd-5f37c62292bd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:33.139766 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7cc58243-aa82-432c-b0bd-5f37c62292bd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:33.205830 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7cc58243-aa82-432c-b0bd-5f37c62292bd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28634 microversion: 2.20 time: 0.080024 Dec 13 23:08:33.206492 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 471/911] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:33 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28634 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:33.951898 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f2d1afba-a217-4663-aec0-ffc422aadf44 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:33.953928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f2d1afba-a217-4663-aec0-ffc422aadf44 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:33.961916 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f2d1afba-a217-4663-aec0-ffc422aadf44 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:33.962418 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f2d1afba-a217-4663-aec0-ffc422aadf44 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:33.963261 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f2d1afba-a217-4663-aec0-ffc422aadf44 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:33.963715 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f2d1afba-a217-4663-aec0-ffc422aadf44 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:34.042238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f2d1afba-a217-4663-aec0-ffc422aadf44 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 27633 microversion: 2.1 time: 0.093914 Dec 13 23:08:34.042882 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 441/912] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:33 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 27633 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:34.217672 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0447eee3-eba6-4213-a8e7-ea17b49b969c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:34.218639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0447eee3-eba6-4213-a8e7-ea17b49b969c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:34.226566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0447eee3-eba6-4213-a8e7-ea17b49b969c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:34.227038 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0447eee3-eba6-4213-a8e7-ea17b49b969c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:34.227864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0447eee3-eba6-4213-a8e7-ea17b49b969c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:34.228293 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0447eee3-eba6-4213-a8e7-ea17b49b969c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:34.297579 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0447eee3-eba6-4213-a8e7-ea17b49b969c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 28634 microversion: 2.20 time: 0.083295 Dec 13 23:08:34.298207 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 472/913] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:34 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 28634 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:35.054871 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8f1b430b-80d8-4ebe-98e3-8a4316aeac61 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:35.055859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8f1b430b-80d8-4ebe-98e3-8a4316aeac61 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:35.076915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8f1b430b-80d8-4ebe-98e3-8a4316aeac61 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:35.077663 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8f1b430b-80d8-4ebe-98e3-8a4316aeac61 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:35.079163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8f1b430b-80d8-4ebe-98e3-8a4316aeac61 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:35.079600 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8f1b430b-80d8-4ebe-98e3-8a4316aeac61 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:35.165576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8f1b430b-80d8-4ebe-98e3-8a4316aeac61 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28175 microversion: 2.1 time: 0.114636 Dec 13 23:08:35.166630 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 442/914] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:35 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28175 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:35.309880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a04d1b8a-5c9b-4dd4-b564-f907edd4c6f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:35.310816 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a04d1b8a-5c9b-4dd4-b564-f907edd4c6f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:35.318742 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a04d1b8a-5c9b-4dd4-b564-f907edd4c6f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:35.319191 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a04d1b8a-5c9b-4dd4-b564-f907edd4c6f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:35.319983 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a04d1b8a-5c9b-4dd4-b564-f907edd4c6f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:35.320476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a04d1b8a-5c9b-4dd4-b564-f907edd4c6f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:35.400657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a04d1b8a-5c9b-4dd4-b564-f907edd4c6f1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 29444 microversion: 2.20 time: 0.094797 Dec 13 23:08:35.401322 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 473/915] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:35 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 29444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:36.184950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-51cee53c-e4ec-487e-b5a0-9cd8c8fa68a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:36.186618 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-51cee53c-e4ec-487e-b5a0-9cd8c8fa68a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:36.194510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51cee53c-e4ec-487e-b5a0-9cd8c8fa68a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:36.194960 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51cee53c-e4ec-487e-b5a0-9cd8c8fa68a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:36.195747 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51cee53c-e4ec-487e-b5a0-9cd8c8fa68a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:36.196179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-51cee53c-e4ec-487e-b5a0-9cd8c8fa68a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:36.261428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-51cee53c-e4ec-487e-b5a0-9cd8c8fa68a5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28175 microversion: 2.1 time: 0.083075 Dec 13 23:08:36.262056 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 443/916] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:36 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28175 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:36.417293 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-735e84a0-2164-4580-a64e-50a14a0f5fa3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:36.419013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-735e84a0-2164-4580-a64e-50a14a0f5fa3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:36.428348 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735e84a0-2164-4580-a64e-50a14a0f5fa3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:36.428801 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735e84a0-2164-4580-a64e-50a14a0f5fa3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:36.429632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735e84a0-2164-4580-a64e-50a14a0f5fa3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:36.430067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-735e84a0-2164-4580-a64e-50a14a0f5fa3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:36.516927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-735e84a0-2164-4580-a64e-50a14a0f5fa3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 30972 microversion: 2.20 time: 0.105721 Dec 13 23:08:36.517516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 474/917] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:36 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 30972 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:37.278553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2d4b1754-36e7-4899-bdb9-4154912bb03d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:37.280055 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2d4b1754-36e7-4899-bdb9-4154912bb03d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:37.291623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d4b1754-36e7-4899-bdb9-4154912bb03d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:37.292376 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d4b1754-36e7-4899-bdb9-4154912bb03d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:37.293772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d4b1754-36e7-4899-bdb9-4154912bb03d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:37.294495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2d4b1754-36e7-4899-bdb9-4154912bb03d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:37.380879 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2d4b1754-36e7-4899-bdb9-4154912bb03d tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28300 microversion: 2.1 time: 0.109264 Dec 13 23:08:37.381555 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 444/918] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:37 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:37.535602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-84b6ed94-851c-44ed-8913-68a50d3ccc79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:37.536681 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-84b6ed94-851c-44ed-8913-68a50d3ccc79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:37.545095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-84b6ed94-851c-44ed-8913-68a50d3ccc79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:37.545661 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-84b6ed94-851c-44ed-8913-68a50d3ccc79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:37.546577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-84b6ed94-851c-44ed-8913-68a50d3ccc79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:37.547088 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-84b6ed94-851c-44ed-8913-68a50d3ccc79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:37.636075 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-84b6ed94-851c-44ed-8913-68a50d3ccc79 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 31980 microversion: 2.20 time: 0.106428 Dec 13 23:08:37.636821 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 475/919] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:37 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 31980 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:38.392820 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5c212b61-aaa2-4950-ac54-8ca0139be8b4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:38.393846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5c212b61-aaa2-4950-ac54-8ca0139be8b4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:38.400971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c212b61-aaa2-4950-ac54-8ca0139be8b4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:38.401403 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c212b61-aaa2-4950-ac54-8ca0139be8b4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:38.402219 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c212b61-aaa2-4950-ac54-8ca0139be8b4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:38.402641 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5c212b61-aaa2-4950-ac54-8ca0139be8b4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:38.485676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5c212b61-aaa2-4950-ac54-8ca0139be8b4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28466 microversion: 2.1 time: 0.096625 Dec 13 23:08:38.486331 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 445/920] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:38 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28466 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:38.655607 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bbb7a569-7ef4-41f0-91ad-cef37d4760bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:38.657091 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bbb7a569-7ef4-41f0-91ad-cef37d4760bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:38.668731 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bbb7a569-7ef4-41f0-91ad-cef37d4760bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:38.669991 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bbb7a569-7ef4-41f0-91ad-cef37d4760bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:38.672166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bbb7a569-7ef4-41f0-91ad-cef37d4760bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:38.673351 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bbb7a569-7ef4-41f0-91ad-cef37d4760bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:38.757638 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bbb7a569-7ef4-41f0-91ad-cef37d4760bf tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 32967 microversion: 2.20 time: 0.109507 Dec 13 23:08:38.758306 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 476/921] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:38 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 32967 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:39.503528 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-72b098f8-d93b-497d-a49f-b12028c93aba tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:39.505151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-72b098f8-d93b-497d-a49f-b12028c93aba tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:39.517140 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-72b098f8-d93b-497d-a49f-b12028c93aba tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:39.517629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-72b098f8-d93b-497d-a49f-b12028c93aba tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:39.518425 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-72b098f8-d93b-497d-a49f-b12028c93aba tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:39.518860 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-72b098f8-d93b-497d-a49f-b12028c93aba tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:39.618556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-72b098f8-d93b-497d-a49f-b12028c93aba tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28634 microversion: 2.1 time: 0.122725 Dec 13 23:08:39.619221 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 446/922] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:39 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:39.771687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a6117a74-65bb-4b1f-bf00-dd81e267e889 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:39.772586 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a6117a74-65bb-4b1f-bf00-dd81e267e889 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:39.779775 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6117a74-65bb-4b1f-bf00-dd81e267e889 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:39.780218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6117a74-65bb-4b1f-bf00-dd81e267e889 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:39.780988 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6117a74-65bb-4b1f-bf00-dd81e267e889 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:39.781445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a6117a74-65bb-4b1f-bf00-dd81e267e889 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:39.853517 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a6117a74-65bb-4b1f-bf00-dd81e267e889 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 33632 microversion: 2.20 time: 0.085526 Dec 13 23:08:39.854555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 477/923] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:39 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 33632 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:40.256493 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1392658855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-757443627", "security_groups": [{"name": "tempest-secgroup-smoke-862593000"}], "block_device_mapping_v2": [{"uuid": "91938485-636d-45a7-95ef-bb8d2db13590", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6646f8aa-a5ae-40b1-af43-1c8579efe381"}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:40.371381 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] validate_networks() for [('6646f8aa-a5ae-40b1-af43-1c8579efe381', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:08:40.631649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b74f31b9-3f80-41fd-89d1-091cee97e342 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:40.632570 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b74f31b9-3f80-41fd-89d1-091cee97e342 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:40.639651 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74f31b9-3f80-41fd-89d1-091cee97e342 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:40.640101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74f31b9-3f80-41fd-89d1-091cee97e342 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:40.640879 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74f31b9-3f80-41fd-89d1-091cee97e342 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:40.641309 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b74f31b9-3f80-41fd-89d1-091cee97e342 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:40.705013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b74f31b9-3f80-41fd-89d1-091cee97e342 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28634 microversion: 2.1 time: 0.076869 Dec 13 23:08:40.705380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 478/924] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:40 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28634 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 23:08:40.747998 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:08:40.748500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:08:40.748870 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:08:40.749278 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:08:40.749743 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:08:40.758582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:40.759022 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:40.759836 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:40.760262 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:40.776063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:08:40.779918 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for user 33969662112e43f6a1c3dd76d70deca4 and project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:08:40.837819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:08:40.841185 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91938485-636d-45a7-95ef-bb8d2db13590',volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:08:40.866516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4191ae22-8477-405c-874d-89718557f7ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:40.867516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4191ae22-8477-405c-874d-89718557f7ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:40.874695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4191ae22-8477-405c-874d-89718557f7ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:40.875143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4191ae22-8477-405c-874d-89718557f7ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:40.875960 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4191ae22-8477-405c-874d-89718557f7ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:40.876396 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4191ae22-8477-405c-874d-89718557f7ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:40.956016 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4191ae22-8477-405c-874d-89718557f7ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 34840 microversion: 2.20 time: 0.093512 Dec 13 23:08:40.957403 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 479/925] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:40 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 34840 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:40.974126 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-97176a79-b2ec-4113-b67f-984ada87a218 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.721625 Dec 13 23:08:40.974772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 447/926] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:08:40 2021] POST /compute/v2.1/servers => generated 405 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:08:40.985367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-de2c2e04-bbbd-4d11-812b-ecbb2209ee03 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:40.986069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-de2c2e04-bbbd-4d11-812b-ecbb2209ee03 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:41.047468 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-de2c2e04-bbbd-4d11-812b-ecbb2209ee03 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:41.055263 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-de2c2e04-bbbd-4d11-812b-ecbb2209ee03 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1094 microversion: 2.1 time: 0.073997 Dec 13 23:08:41.055807 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 480/927] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:40 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:41.716912 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ce760256-fcb0-47a6-b566-89af0c3b2fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:41.717822 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ce760256-fcb0-47a6-b566-89af0c3b2fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:41.725131 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ce760256-fcb0-47a6-b566-89af0c3b2fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:41.725609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ce760256-fcb0-47a6-b566-89af0c3b2fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:41.726398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ce760256-fcb0-47a6-b566-89af0c3b2fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:41.726831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ce760256-fcb0-47a6-b566-89af0c3b2fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:41.797735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ce760256-fcb0-47a6-b566-89af0c3b2fe3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28634 microversion: 2.1 time: 0.085007 Dec 13 23:08:41.798467 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 448/928] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:41 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28634 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:41.968945 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c05d5d9b-06b8-4e46-8121-2ab9e5a96253 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:41.969863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c05d5d9b-06b8-4e46-8121-2ab9e5a96253 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:41.977415 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05d5d9b-06b8-4e46-8121-2ab9e5a96253 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:41.977852 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05d5d9b-06b8-4e46-8121-2ab9e5a96253 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:41.978653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05d5d9b-06b8-4e46-8121-2ab9e5a96253 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:41.979101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c05d5d9b-06b8-4e46-8121-2ab9e5a96253 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:42.061437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c05d5d9b-06b8-4e46-8121-2ab9e5a96253 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 35967 microversion: 2.20 time: 0.096011 Dec 13 23:08:42.062086 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 481/929] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:41 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 35967 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:42.073608 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:42.074318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:42.081580 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:42.082241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:42.083019 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:42.083443 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:42.147971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:42.158000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f8437f80-be04-423c-9263-2ef0872b7749 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1192 microversion: 2.1 time: 0.088211 Dec 13 23:08:42.158812 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 449/930] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:42 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:42.811946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bc62324c-8e8f-401b-aad6-33c3683b80e3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:42.812959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bc62324c-8e8f-401b-aad6-33c3683b80e3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:42.827890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc62324c-8e8f-401b-aad6-33c3683b80e3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:42.828347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc62324c-8e8f-401b-aad6-33c3683b80e3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:42.829492 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc62324c-8e8f-401b-aad6-33c3683b80e3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:42.829994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc62324c-8e8f-401b-aad6-33c3683b80e3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:42.899849 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bc62324c-8e8f-401b-aad6-33c3683b80e3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 28634 microversion: 2.1 time: 0.092752 Dec 13 23:08:42.900959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 482/931] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:42 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 28634 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:43.074114 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-356390e2-b624-471b-b752-843b8b0cc0ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:43.075032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-356390e2-b624-471b-b752-843b8b0cc0ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:43.081574 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-356390e2-b624-471b-b752-843b8b0cc0ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:43.082027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-356390e2-b624-471b-b752-843b8b0cc0ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:43.082859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-356390e2-b624-471b-b752-843b8b0cc0ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:43.083291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-356390e2-b624-471b-b752-843b8b0cc0ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:43.158387 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-356390e2-b624-471b-b752-843b8b0cc0ea tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 37264 microversion: 2.20 time: 0.087711 Dec 13 23:08:43.162817 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 450/932] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:43 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 37264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:43.182403 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:43.183257 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:43.190994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:43.191438 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:43.192623 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:43.193059 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:43.434611 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:43.443214 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-31308cef-b1cf-4d6f-9972-b913ffb294b7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.264658 Dec 13 23:08:43.443795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 483/933] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:43 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:08:43.723649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-11f15bf8-e480-42cd-ba4a-37f6ac4384ae req-bd48db39-b73f-4f9a-a28f-a977f31d0994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e689912f-fc16-4bf4-8ec3-c7c312c41fb9", "tag": "6b8fadde-582e-4953-a8a1-5cdaca48e38c"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:43.727735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:43.727735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:08:43.736109 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-11f15bf8-e480-42cd-ba4a-37f6ac4384ae req-bd48db39-b73f-4f9a-a28f-a977f31d0994 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:43.736553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-11f15bf8-e480-42cd-ba4a-37f6ac4384ae req-bd48db39-b73f-4f9a-a28f-a977f31d0994 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:43.748935 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-11f15bf8-e480-42cd-ba4a-37f6ac4384ae req-bd48db39-b73f-4f9a-a28f-a977f31d0994 service nova] Creating event network-changed:6b8fadde-582e-4953-a8a1-5cdaca48e38c for instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 on hv-cinder-79628 Dec 13 23:08:43.754551 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-11f15bf8-e480-42cd-ba4a-37f6ac4384ae req-bd48db39-b73f-4f9a-a28f-a977f31d0994 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103435 Dec 13 23:08:43.755227 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 451/934] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:43.912374 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ee1f3bd9-a205-4072-833b-d66c5a96b7c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:43.914442 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ee1f3bd9-a205-4072-833b-d66c5a96b7c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:43.924020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1f3bd9-a205-4072-833b-d66c5a96b7c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:43.924739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1f3bd9-a205-4072-833b-d66c5a96b7c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:43.926050 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1f3bd9-a205-4072-833b-d66c5a96b7c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:43.926793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ee1f3bd9-a205-4072-833b-d66c5a96b7c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:44.014651 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ee1f3bd9-a205-4072-833b-d66c5a96b7c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 29744 microversion: 2.1 time: 0.105974 Dec 13 23:08:44.018805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 484/935] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:43 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 29744 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:44.171170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ee660601-1b53-4934-b497-0edcf9548201 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:44.172373 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ee660601-1b53-4934-b497-0edcf9548201 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:44.179788 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee660601-1b53-4934-b497-0edcf9548201 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:44.180235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee660601-1b53-4934-b497-0edcf9548201 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:44.181021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee660601-1b53-4934-b497-0edcf9548201 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:44.181486 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ee660601-1b53-4934-b497-0edcf9548201 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:44.262180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ee660601-1b53-4934-b497-0edcf9548201 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 38184 microversion: 2.20 time: 0.094995 Dec 13 23:08:44.262839 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 452/936] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:44 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 38184 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:44.462978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:44.463622 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:44.472569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:44.473039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:44.473818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:44.474287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:44.703815 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:44.711680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4230bc6f-8af4-4b53-b87c-659cecf62210 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.253983 Dec 13 23:08:44.712283 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 485/937] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:44 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:08:45.027405 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2e03f348-95de-4a26-9223-ca842ff1ffd2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:45.028320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2e03f348-95de-4a26-9223-ca842ff1ffd2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:45.035664 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e03f348-95de-4a26-9223-ca842ff1ffd2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:45.036111 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e03f348-95de-4a26-9223-ca842ff1ffd2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:45.036888 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e03f348-95de-4a26-9223-ca842ff1ffd2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:45.037327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2e03f348-95de-4a26-9223-ca842ff1ffd2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:45.117107 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2e03f348-95de-4a26-9223-ca842ff1ffd2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 31471 microversion: 2.1 time: 0.093771 Dec 13 23:08:45.117807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 453/938] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:45 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 31471 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:45.274601 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-04fb6d0c-aa30-4cef-8ee4-d5b2af2de8ce tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:45.275544 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-04fb6d0c-aa30-4cef-8ee4-d5b2af2de8ce tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:45.282446 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04fb6d0c-aa30-4cef-8ee4-d5b2af2de8ce tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:45.282824 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04fb6d0c-aa30-4cef-8ee4-d5b2af2de8ce tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:45.283619 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04fb6d0c-aa30-4cef-8ee4-d5b2af2de8ce tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:45.284041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-04fb6d0c-aa30-4cef-8ee4-d5b2af2de8ce tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:45.351384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-04fb6d0c-aa30-4cef-8ee4-d5b2af2de8ce tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 38184 microversion: 2.20 time: 0.080356 Dec 13 23:08:45.352439 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 486/939] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:45 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 38184 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:45.734122 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:45.735308 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:45.747075 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:45.747806 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:45.749079 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:45.749860 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:45.912801 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:45.924283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7d679d30-af2e-43df-83ba-15f528620e48 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.197602 Dec 13 23:08:45.925524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 454/940] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:45 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:46.134151 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c2b812b3-e3b6-4440-bf8c-2c1a27161747 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:46.135768 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c2b812b3-e3b6-4440-bf8c-2c1a27161747 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:46.146041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2b812b3-e3b6-4440-bf8c-2c1a27161747 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:46.146489 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2b812b3-e3b6-4440-bf8c-2c1a27161747 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:46.147313 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2b812b3-e3b6-4440-bf8c-2c1a27161747 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:46.147747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2b812b3-e3b6-4440-bf8c-2c1a27161747 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:46.221146 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c2b812b3-e3b6-4440-bf8c-2c1a27161747 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 33260 microversion: 2.1 time: 0.093471 Dec 13 23:08:46.222996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 487/941] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:46 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 33260 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:46.368329 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-dc6a0ff7-e845-4a99-bd44-76447b35f55d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:46.369856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-dc6a0ff7-e845-4a99-bd44-76447b35f55d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:46.379544 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-dc6a0ff7-e845-4a99-bd44-76447b35f55d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:46.379992 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-dc6a0ff7-e845-4a99-bd44-76447b35f55d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:46.380756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-dc6a0ff7-e845-4a99-bd44-76447b35f55d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:46.381190 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-dc6a0ff7-e845-4a99-bd44-76447b35f55d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:46.446787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-dc6a0ff7-e845-4a99-bd44-76447b35f55d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 38184 microversion: 2.20 time: 0.084265 Dec 13 23:08:46.447588 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 455/942] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:46 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 38184 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:46.946788 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:46.947761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:46.958378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:46.958818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:46.959609 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:46.960043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:47.127606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:47.136765 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e0075b21-1270-4215-8bbe-188edfbfe7db tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.197999 Dec 13 23:08:47.137395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 488/943] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:46 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:47.242283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-027a07d0-a475-44df-975a-c69044a11c3b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:47.243295 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-027a07d0-a475-44df-975a-c69044a11c3b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:47.250683 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-027a07d0-a475-44df-975a-c69044a11c3b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:47.251129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-027a07d0-a475-44df-975a-c69044a11c3b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:47.251989 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-027a07d0-a475-44df-975a-c69044a11c3b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:47.252422 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-027a07d0-a475-44df-975a-c69044a11c3b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:47.336668 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-027a07d0-a475-44df-975a-c69044a11c3b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 34295 microversion: 2.1 time: 0.100590 Dec 13 23:08:47.337327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 456/944] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:47 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 34295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:47.462961 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-af97c630-b595-442e-91d9-82408947f7e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:47.464350 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-af97c630-b595-442e-91d9-82408947f7e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:47.474529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-af97c630-b595-442e-91d9-82408947f7e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:47.475219 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-af97c630-b595-442e-91d9-82408947f7e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:47.476497 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-af97c630-b595-442e-91d9-82408947f7e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:47.477189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-af97c630-b595-442e-91d9-82408947f7e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:47.552957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-af97c630-b595-442e-91d9-82408947f7e0 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 200 len: 38323 microversion: 2.20 time: 0.095487 Dec 13 23:08:47.553633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 489/945] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:47 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 38323 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:08:47.566667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9da6de4d-5cb7-4a19-ad11-b14c5417c404 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:47.567263 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9da6de4d-5cb7-4a19-ad11-b14c5417c404 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:47.574697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9da6de4d-5cb7-4a19-ad11-b14c5417c404 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:47.575150 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9da6de4d-5cb7-4a19-ad11-b14c5417c404 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:47.575954 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9da6de4d-5cb7-4a19-ad11-b14c5417c404 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:47.576365 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9da6de4d-5cb7-4a19-ad11-b14c5417c404 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:47.609363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9da6de4d-5cb7-4a19-ad11-b14c5417c404 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/ips" status: 200 len: 151 microversion: 2.20 time: 0.047328 Dec 13 23:08:47.609976 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 457/946] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Dec 13 23:08:47 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:48.155689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:48.156384 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:48.163989 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:48.164436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:48.165234 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:48.165693 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:48.317387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:48.325552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c4b5cb00-3d2f-4d9c-88d1-e39dce4b3e62 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.174020 Dec 13 23:08:48.326128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 490/947] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:48 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:48.348548 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bd29f300-fa5c-41be-9357-7926191114ff tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:48.349634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bd29f300-fa5c-41be-9357-7926191114ff tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:48.356519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bd29f300-fa5c-41be-9357-7926191114ff tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:48.356972 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bd29f300-fa5c-41be-9357-7926191114ff tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:48.357783 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bd29f300-fa5c-41be-9357-7926191114ff tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:48.358219 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bd29f300-fa5c-41be-9357-7926191114ff tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:48.442243 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bd29f300-fa5c-41be-9357-7926191114ff tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 35413 microversion: 2.1 time: 0.096895 Dec 13 23:08:48.443069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 458/948] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:48 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 35413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:49.347137 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:49.348128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:49.354968 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.355417 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:49.356195 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.356627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:49.457143 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d0595639-f447-4d4d-860d-a85b0f7d82d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:49.458298 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d0595639-f447-4d4d-860d-a85b0f7d82d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:49.465907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0595639-f447-4d4d-860d-a85b0f7d82d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.466317 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0595639-f447-4d4d-860d-a85b0f7d82d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:49.467111 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0595639-f447-4d4d-860d-a85b0f7d82d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.467547 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d0595639-f447-4d4d-860d-a85b0f7d82d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:49.500745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:49.508979 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1d7a2e67-dafd-4d27-9219-264c6c1dd678 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.168248 Dec 13 23:08:49.509601 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 491/949] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:49 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:49.552072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d0595639-f447-4d4d-860d-a85b0f7d82d1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 36889 microversion: 2.1 time: 0.098788 Dec 13 23:08:49.552713 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 459/950] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:49 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 36889 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:49.603247 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:49.603695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:49.610755 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.611206 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:49.611989 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.612421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:49.635618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lazy-loading 'flavor' on Instance uuid 94fdf52d-3f52-4676-8602-74d204bfc44a {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:08:49.908082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-61df0958-31d3-4351-8247-bc405179fbfd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 202 len: 0 microversion: 2.20 time: 0.308559 Dec 13 23:08:49.908716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 492/951] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:08:49 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:08:49.917479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:49.918152 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:49.925506 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.926136 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:49.927018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:49.927448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:50.067593 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:50.075367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:50.076844 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:50.078052 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-415e29c7-c5f4-4820-91b1-cf0b94aa2ed8 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.164777 Dec 13 23:08:50.078607 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 460/952] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:49 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:50.528898 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:50.529701 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:50.537892 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:50.538393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:50.539258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:50.539734 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:50.564007 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-896a4234-df06-43ee-b7aa-f74008b2caf4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:50.564963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-896a4234-df06-43ee-b7aa-f74008b2caf4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:50.571963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-896a4234-df06-43ee-b7aa-f74008b2caf4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:50.572399 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-896a4234-df06-43ee-b7aa-f74008b2caf4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:50.573184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-896a4234-df06-43ee-b7aa-f74008b2caf4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:50.573642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-896a4234-df06-43ee-b7aa-f74008b2caf4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:50.648340 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-896a4234-df06-43ee-b7aa-f74008b2caf4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 38168 microversion: 2.1 time: 0.087596 Dec 13 23:08:50.648992 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 461/953] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:50 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 38168 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:50.702913 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:50.712402 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b7df3b9a-4c6b-4a45-924f-2380df94d854 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.188644 Dec 13 23:08:50.712972 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 493/954] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:50 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:51.101887 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:51.103060 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:51.114698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:51.114819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:51.115536 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:51.115965 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:51.258431 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:51.266227 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:51.267701 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:51.268843 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-734b4904-008b-4285-bf4d-b7b7041a7765 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.173976 Dec 13 23:08:51.269399 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 462/955] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:51 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:51.663949 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3d7046ee-6fa1-4414-8a7f-f0e068a9e0fd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:51.664941 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3d7046ee-6fa1-4414-8a7f-f0e068a9e0fd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:51.671461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d7046ee-6fa1-4414-8a7f-f0e068a9e0fd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:51.671914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d7046ee-6fa1-4414-8a7f-f0e068a9e0fd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:51.672697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d7046ee-6fa1-4414-8a7f-f0e068a9e0fd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:51.673126 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3d7046ee-6fa1-4414-8a7f-f0e068a9e0fd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:51.728997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:51.729716 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:51.736904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:51.737441 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:51.738358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3d7046ee-6fa1-4414-8a7f-f0e068a9e0fd tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 38168 microversion: 2.1 time: 0.079969 Dec 13 23:08:51.738524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:51.738956 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:51.740234 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 494/956] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:51 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 38168 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:51.873081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:51.880729 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cf4caab7-dff7-4a95-9325-fa3817957cec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.155522 Dec 13 23:08:51.881284 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 463/957] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:51 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:52.288981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:52.289609 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:52.296543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:52.296982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:52.297784 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:52.298243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:52.434940 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:52.442984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:52.444601 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:52.445825 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-09b55ffe-1b18-4a92-916e-00b087084dcc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.161983 Dec 13 23:08:52.446359 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 495/958] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:52 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:52.751787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bee45753-9244-46ca-ae49-48afc37a19cb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:52.752855 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bee45753-9244-46ca-ae49-48afc37a19cb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:52.760649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bee45753-9244-46ca-ae49-48afc37a19cb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:52.761172 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bee45753-9244-46ca-ae49-48afc37a19cb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:52.762120 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bee45753-9244-46ca-ae49-48afc37a19cb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:52.762627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bee45753-9244-46ca-ae49-48afc37a19cb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:52.824648 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bee45753-9244-46ca-ae49-48afc37a19cb tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 38168 microversion: 2.1 time: 0.077153 Dec 13 23:08:52.825597 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 464/959] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:52 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 38168 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:52.897792 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:52.898408 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:52.905109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:52.905584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:52.906355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:52.906779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:53.068257 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:53.076041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-881ffc40-f971-4e83-a99b-cfdd53666602 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.181987 Dec 13 23:08:53.076602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 496/960] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:52 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:53.469496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:53.470628 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:53.482127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:53.482893 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:53.484179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:53.484951 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:53.623310 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:53.632397 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:53.633932 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:53.635102 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4f13dbfa-9041-45f4-b02b-b4117a3127d6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.172657 Dec 13 23:08:53.635665 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 465/961] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:53 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:53.836198 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d50ad2ca-844a-417a-a726-07b94c334495 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:53.837194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d50ad2ca-844a-417a-a726-07b94c334495 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:53.843610 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d50ad2ca-844a-417a-a726-07b94c334495 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:53.844173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d50ad2ca-844a-417a-a726-07b94c334495 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:53.845031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d50ad2ca-844a-417a-a726-07b94c334495 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:53.845582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d50ad2ca-844a-417a-a726-07b94c334495 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:53.851669 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-504cb28a-a77d-4c4c-9a14-4a9b11bbcde6 req-7dbf2187-47d8-4714-96af-52e70fec3e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e689912f-fc16-4bf4-8ec3-c7c312c41fb9", "name": "network-vif-plugged", "status": "completed", "tag": "6b8fadde-582e-4953-a8a1-5cdaca48e38c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:53.853287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:53.853287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:08:53.868622 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-504cb28a-a77d-4c4c-9a14-4a9b11bbcde6 req-7dbf2187-47d8-4714-96af-52e70fec3e0d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:53.869060 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-504cb28a-a77d-4c4c-9a14-4a9b11bbcde6 req-7dbf2187-47d8-4714-96af-52e70fec3e0d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:53.880715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-504cb28a-a77d-4c4c-9a14-4a9b11bbcde6 req-7dbf2187-47d8-4714-96af-52e70fec3e0d service nova] Creating event network-vif-plugged:6b8fadde-582e-4953-a8a1-5cdaca48e38c for instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 on hv-cinder-79628 Dec 13 23:08:53.885709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-504cb28a-a77d-4c4c-9a14-4a9b11bbcde6 req-7dbf2187-47d8-4714-96af-52e70fec3e0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097930 Dec 13 23:08:53.886320 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 497/962] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:53.907967 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d50ad2ca-844a-417a-a726-07b94c334495 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 38168 microversion: 2.1 time: 0.075268 Dec 13 23:08:53.908611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 466/963] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:53 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 38168 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:54.092718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:54.093421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:54.099934 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:54.100386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:54.101173 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:54.101753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:54.266555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:54.275005 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-636c2bc2-0557-464d-a75b-908b8aeaeaec tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1265 microversion: 2.1 time: 0.186383 Dec 13 23:08:54.275552 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 498/964] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:54 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:54.656275 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:54.657015 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:54.666274 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:54.666718 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:54.667492 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:54.667928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:54.817703 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:54.829755 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:54.832205 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:54.833949 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-83c4ea55-acea-40a3-940c-cc7cf8e76af4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.182524 Dec 13 23:08:54.834858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 467/965] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:54 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:54.923127 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b089f44e-2405-4e15-9832-427196b9968c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:54.924442 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b089f44e-2405-4e15-9832-427196b9968c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:54.932909 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b089f44e-2405-4e15-9832-427196b9968c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:54.933366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b089f44e-2405-4e15-9832-427196b9968c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:54.934141 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b089f44e-2405-4e15-9832-427196b9968c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:54.934568 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b089f44e-2405-4e15-9832-427196b9968c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.021164 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b089f44e-2405-4e15-9832-427196b9968c tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action" status: 200 len: 38299 microversion: 2.1 time: 0.103715 Dec 13 23:08:55.021849 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 499/966] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:54 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/action => generated 38299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:08:55.031862 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bf349c8e-bae5-4ca8-a50d-c29fb99a3ac3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:55.032373 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bf349c8e-bae5-4ca8-a50d-c29fb99a3ac3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:55.039020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf349c8e-bae5-4ca8-a50d-c29fb99a3ac3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.039464 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf349c8e-bae5-4ca8-a50d-c29fb99a3ac3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.040235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf349c8e-bae5-4ca8-a50d-c29fb99a3ac3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.040661 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bf349c8e-bae5-4ca8-a50d-c29fb99a3ac3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.066658 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bf349c8e-bae5-4ca8-a50d-c29fb99a3ac3 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/ips" status: 200 len: 146 microversion: 2.1 time: 0.038518 Dec 13 23:08:55.067222 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 468/967] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Dec 13 23:08:55 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:55.292756 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:55.293620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:55.302057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.302670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.303619 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.304051 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.337751 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:55.338520 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:55.344911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.345384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.346169 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.347436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.374296 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lazy-loading 'flavor' on Instance uuid 776bb0b5-5864-48f0-b212-af69708aae04 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:08:55.448934 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-67ab24d6-84a9-4ade-9cb8-bcf68e816a81 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "POST /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04/action" status: 202 len: 0 microversion: 2.1 time: 0.115000 Dec 13 23:08:55.449931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 469/968] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:08:55 2021] POST /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:08:55.458058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:55.458762 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:55.459142 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:55.465666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.466105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.467021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.467381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-659a2553-1b6a-47d0-8995-616a9322ad16 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1453 microversion: 2.1 time: 0.179329 Dec 13 23:08:55.467508 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.478793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 500/969] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:55 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:55.483442 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:55.484047 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:55.490222 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.490915 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.491962 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.492545 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.670027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:55.673694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:55.678104 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-eaeb05d8-431c-4e06-b02e-a4f5008baadd tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.224039 Dec 13 23:08:55.679028 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 470/970] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:55 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:55.682049 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ca6bed2f-57d7-4d62-9bff-334cf33c3154 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1453 microversion: 2.1 time: 0.202161 Dec 13 23:08:55.682616 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 501/971] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:55 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:55.852131 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:55.853206 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:55.860484 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.860987 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.861870 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:55.862333 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:55.992496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:56.000436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:56.001972 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:56.003139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-072cbb33-5dd6-47ea-85d5-7b2bf50cceb4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.154861 Dec 13 23:08:56.003705 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 471/972] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:55 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:56.385235 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0d239a2e-1f32-456d-9d72-95d3814a455e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e78f5a2-5bbb-4ab1-a3a0-a5b1af71cd47"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:56.386383 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0d239a2e-1f32-456d-9d72-95d3814a455e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:56.392800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d239a2e-1f32-456d-9d72-95d3814a455e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:56.393238 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d239a2e-1f32-456d-9d72-95d3814a455e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:56.394073 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d239a2e-1f32-456d-9d72-95d3814a455e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:56.394498 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0d239a2e-1f32-456d-9d72-95d3814a455e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:56.629608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0d239a2e-1f32-456d-9d72-95d3814a455e tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247969 Dec 13 23:08:56.636199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 502/973] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:08:56 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:08:56.695659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:56.697075 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:56.703586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:56.704033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:56.704975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:56.705640 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:56.844161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:56.852686 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cc76e8d8-b37e-448c-81be-a2276a218f5f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.160667 Dec 13 23:08:56.853232 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 472/974] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:56 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:57.023565 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:57.024192 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:57.030554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:57.031000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:57.031827 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:57.032259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:57.166862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:57.175157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:57.176660 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:57.177862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c6203c59-94e4-462c-b8c7-20325244a47b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.159353 Dec 13 23:08:57.178587 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 503/975] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:57 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:57.525825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-e9a01da3-2378-48cd-92a0-ba600bec2725 req-7b66ffc2-6b9d-44e4-bc3b-cf4aabbe885d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e689912f-fc16-4bf4-8ec3-c7c312c41fb9", "tag": "6b8fadde-582e-4953-a8a1-5cdaca48e38c"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:08:57.527393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:08:57.527393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:08:57.534379 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-e9a01da3-2378-48cd-92a0-ba600bec2725 req-7b66ffc2-6b9d-44e4-bc3b-cf4aabbe885d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:57.534820 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-e9a01da3-2378-48cd-92a0-ba600bec2725 req-7b66ffc2-6b9d-44e4-bc3b-cf4aabbe885d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:57.546188 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-e9a01da3-2378-48cd-92a0-ba600bec2725 req-7b66ffc2-6b9d-44e4-bc3b-cf4aabbe885d service nova] Creating event network-changed:6b8fadde-582e-4953-a8a1-5cdaca48e38c for instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 on hv-cinder-79628 Dec 13 23:08:57.551532 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-e9a01da3-2378-48cd-92a0-ba600bec2725 req-7b66ffc2-6b9d-44e4-bc3b-cf4aabbe885d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085324 Dec 13 23:08:57.552138 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 473/976] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:08:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:08:57.871604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:57.872294 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:57.879039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:57.879730 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:57.880607 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:57.881171 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:58.113367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:58.122171 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-298bfa59-23a4-494f-8f8f-c32e2416d7b6 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.254210 Dec 13 23:08:58.122864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 504/977] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:57 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:58.197487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:58.198271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:58.205058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:58.205586 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:58.206408 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:58.206838 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:58.350285 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:58.358969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:58.360421 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:58.361627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-45fc980f-af46-45af-bb17-dd40fd0fe05e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.168725 Dec 13 23:08:58.362204 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 474/978] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:58 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:08:59.139933 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:59.140539 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:59.147230 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:59.147847 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:59.148618 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:59.149044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:59.290883 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:59.301931 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ec3425e3-6a34-4d31-9955-da4e022f965e tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.165508 Dec 13 23:08:59.302571 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 505/979] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:08:59 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:08:59.384297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:08:59.385477 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:08:59.396083 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:59.396842 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:59.397817 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:08:59.398251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:08:59.539592 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:59.547396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:59.548881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:08:59.550448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ec44567a-a6a1-48d1-ac20-2d56415b5682 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.171950 Dec 13 23:08:59.551053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 475/980] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:08:59 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:00.323543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:00.324483 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:00.335276 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:00.335728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:00.336518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:00.336946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:00.472284 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:00.480478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-14ede1c6-2262-4c6a-8fbc-e4dd765c6bb8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.163619 Dec 13 23:09:00.481044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 506/981] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:00 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:00.572799 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:00.573631 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:00.581731 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:00.582293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:00.583254 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:00.583790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:00.735127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:00.747534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:00.749964 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:00.751697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-95e19de4-9d32-4515-98d0-ae94b9311c19 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.184612 Dec 13 23:09:00.752497 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 476/982] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:00 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:01.501244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:01.501908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:01.509721 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:01.510194 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:01.510970 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:01.511487 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:01.656664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:01.664335 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-30ab2e8a-e17e-4b6b-8fd7-314575e7c067 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.167416 Dec 13 23:09:01.665259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 507/983] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:01 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:01.772611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:01.773174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:01.779810 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:01.780235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:01.781026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:01.781496 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:01.929925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:01.938149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:01.939929 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:01.941110 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5a19e50c-a84f-4d99-abc3-613cc124499e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.172745 Dec 13 23:09:01.941928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 477/984] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:01 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:02.682897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:02.683524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:02.690131 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:02.690567 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:02.691338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:02.691766 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:02.960342 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:02.960997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:02.968369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:02.968821 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:02.969658 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:02.970109 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:03.112536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:03.120549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6e558f7e-a2da-4e01-becd-a707a6a67be2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.441497 Dec 13 23:09:03.121532 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 508/985] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:02 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:03.126185 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-da5fd29c-615b-4909-b095-d3488b9e1569 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:03.132333 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-da5fd29c-615b-4909-b095-d3488b9e1569 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:03.145300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da5fd29c-615b-4909-b095-d3488b9e1569 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:03.145918 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da5fd29c-615b-4909-b095-d3488b9e1569 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:03.146909 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da5fd29c-615b-4909-b095-d3488b9e1569 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:03.147311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-da5fd29c-615b-4909-b095-d3488b9e1569 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:03.177437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-da5fd29c-615b-4909-b095-d3488b9e1569 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054713 Dec 13 23:09:03.178075 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 509/986] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:09:03 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:03.181509 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:03.187733 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-10f4d5ed-da34-4a42-896b-6e2905d6b60a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:03.188218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-10f4d5ed-da34-4a42-896b-6e2905d6b60a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:03.189479 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:03.190956 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:03.192323 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c0f660fb-f345-43d8-8279-c48eb20e6cc6 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.235946 Dec 13 23:09:03.192841 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 478/987] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:02 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:03.194574 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10f4d5ed-da34-4a42-896b-6e2905d6b60a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:03.195025 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10f4d5ed-da34-4a42-896b-6e2905d6b60a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:03.195813 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10f4d5ed-da34-4a42-896b-6e2905d6b60a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:03.196245 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-10f4d5ed-da34-4a42-896b-6e2905d6b60a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:03.225323 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-10f4d5ed-da34-4a42-896b-6e2905d6b60a tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/8e78f5a2-5bbb-4ab1-a3a0-a5b1af71cd47" status: 200 len: 194 microversion: 2.1 time: 0.040982 Dec 13 23:09:03.225819 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 510/988] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Dec 13 23:09:03 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/8e78f5a2-5bbb-4ab1-a3a0-a5b1af71cd47 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:04.142909 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:04.143514 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:04.151534 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:04.151980 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:04.152743 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:04.153170 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:04.212286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:04.212851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:04.219680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:04.220133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:04.221158 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:04.221650 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:04.320858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:04.328282 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bb222c04-ca5a-449d-b1f3-fa25567cd999 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.191334 Dec 13 23:09:04.328825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 479/989] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:04 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:04.391334 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:04.403822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:04.406029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:04.407800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-be3f2092-69c2-4b03-b2a3-e5fa18e947f4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.199710 Dec 13 23:09:04.408602 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 511/990] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:04 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:04.545837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-404e1c7b-460d-4d3a-b3ea-e4b444b578ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a47a0a46-3fa0-4229-895f-a7df767a2872"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:04.546990 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-404e1c7b-460d-4d3a-b3ea-e4b444b578ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:04.553859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-404e1c7b-460d-4d3a-b3ea-e4b444b578ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:04.554320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-404e1c7b-460d-4d3a-b3ea-e4b444b578ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:04.555089 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-404e1c7b-460d-4d3a-b3ea-e4b444b578ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:04.555510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-404e1c7b-460d-4d3a-b3ea-e4b444b578ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:04.807601 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-404e1c7b-460d-4d3a-b3ea-e4b444b578ca tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265608 Dec 13 23:09:04.810475 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 480/991] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:09:04 2021] POST /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:05.348003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:05.348613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:05.355557 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:05.356001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:05.356778 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:05.357199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:05.429485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:05.430182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:05.436414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:05.436834 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:05.437644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:05.438065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:05.600497 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:05.608218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-88fb54c8-7c31-40f7-96f6-18377bb2a2a2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.263993 Dec 13 23:09:05.608790 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 512/992] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:05 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:05.753254 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:05.762406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:05.763911 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:05.765058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-819db264-5d69-4075-835c-b92194647e4f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1742 microversion: 2.20 time: 0.340770 Dec 13 23:09:05.765657 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 481/993] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:05 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1742 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:09:06.627644 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:06.628244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:06.635180 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:06.635620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:06.636395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:06.636820 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:06.784413 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:06.785056 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:06.786144 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:06.792248 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:06.792696 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:06.793522 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:06.793953 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:06.794632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d9149b03-a270-42ae-8714-86d5f1261ced tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.171986 Dec 13 23:09:06.795258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 513/994] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:06 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:06.926306 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:06.935080 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:06.936533 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:06.937712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b4f68f19-9960-460b-9c04-6c057e260221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1742 microversion: 2.20 time: 0.157405 Dec 13 23:09:06.939990 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 482/995] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:06 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:07.812271 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:07.813782 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:07.821032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:07.821710 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:07.822675 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:07.823243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:07.960870 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:07.961513 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:07.968041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:07.968720 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:07.969910 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:07.970347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:07.975888 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:07.985982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bf9000bf-2d76-47b1-9fa3-c445077ce9e3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.177230 Dec 13 23:09:07.989210 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 514/996] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:07 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:08.130155 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:08.139761 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:08.141499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:08.142788 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7adfaf10-0a43-4b26-9f17-01bea4c3d597 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.187756 Dec 13 23:09:08.143344 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 483/997] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:07 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:09.005740 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:09.006348 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:09.013463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.013911 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.014688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.015121 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.161405 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:09.162023 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:09.171477 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.171937 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:09.172638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.173853 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.174298 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.183950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-78fc2c51-c846-4fa9-ac94-6e6a6d79a2a3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1510 microversion: 2.1 time: 0.181672 Dec 13 23:09:09.184792 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 515/998] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:09 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:09.200516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4ed80205-8b7b-48ad-a064-95d173a0972d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:09.201513 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4ed80205-8b7b-48ad-a064-95d173a0972d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:09.208135 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ed80205-8b7b-48ad-a064-95d173a0972d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.208863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ed80205-8b7b-48ad-a064-95d173a0972d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.210030 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ed80205-8b7b-48ad-a064-95d173a0972d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.210624 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4ed80205-8b7b-48ad-a064-95d173a0972d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.353963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:09.363001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:09.370166 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:09.373149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3acb1b00-f63b-40af-a955-fc2d5dcfa4fe tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.214497 Dec 13 23:09:09.374396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 484/999] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:09 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:09:09.464501 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4ed80205-8b7b-48ad-a064-95d173a0972d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "POST /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04/action" status: 202 len: 0 microversion: 2.1 time: 0.267536 Dec 13 23:09:09.465771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 516/1000] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:09:09 2021] POST /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 13 23:09:09.473481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:09.474197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:09.487378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.487972 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.489090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.489687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.668690 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:09.684188 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6fe47005-b853-4041-81d4-a600e1813cce tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1518 microversion: 2.1 time: 0.214404 Dec 13 23:09:09.685008 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 485/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:09 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1518 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:09.922028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-920730e1-c8a1-473e-ad01-e9a02b40e720 req-e0899592-313f-4dfb-974e-2335c5d9ae3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fdf52d-3f52-4676-8602-74d204bfc44a", "name": "network-vif-plugged", "status": "completed", "tag": "0a5e01cf-66ab-49f7-9779-2dc2d108f971"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:09.923802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:09:09.923802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:09:09.932910 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-920730e1-c8a1-473e-ad01-e9a02b40e720 req-e0899592-313f-4dfb-974e-2335c5d9ae3f service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:09.933599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-920730e1-c8a1-473e-ad01-e9a02b40e720 req-e0899592-313f-4dfb-974e-2335c5d9ae3f service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:09.947422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-920730e1-c8a1-473e-ad01-e9a02b40e720 req-e0899592-313f-4dfb-974e-2335c5d9ae3f service nova] Creating event network-vif-plugged:0a5e01cf-66ab-49f7-9779-2dc2d108f971 for instance 94fdf52d-3f52-4676-8602-74d204bfc44a on hv-cinder-79628 Dec 13 23:09:09.960381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-920730e1-c8a1-473e-ad01-e9a02b40e720 req-e0899592-313f-4dfb-974e-2335c5d9ae3f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046941 Dec 13 23:09:09.970898 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 517/1002] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:09:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:10.392255 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:10.393062 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:10.399922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:10.400361 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:10.401145 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:10.401603 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:10.547577 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:10.556706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:10.558563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:10.559937 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0feea9ad-5481-48d0-8607-612bb898f01b tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.171747 Dec 13 23:09:10.572168 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 486/1003] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:10 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:10.724404 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:10.730613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:10.752728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:10.754107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:10.755306 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:10.756154 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:10.979095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:10.986874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-027ac13f-b031-4bf5-960f-419c88e37b2b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1520 microversion: 2.1 time: 0.279556 Dec 13 23:09:10.987474 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 518/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:10 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:11.579907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:11.580562 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:11.592992 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:11.593879 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:11.594914 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:11.595526 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:11.735688 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:11.744401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:11.746086 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:11.747327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-90f02a30-1c32-4cac-b670-59485ffbb3dc tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.171989 Dec 13 23:09:11.757489 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 487/1005] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:11 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:09:11.995894 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-c914986c-4f8b-4718-8c77-861eff97936c req-527f356e-7201-44d0-a57c-8ec5af9e92c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776bb0b5-5864-48f0-b212-af69708aae04", "name": "network-vif-unplugged", "status": "completed", "tag": "e9a3ffe7-75df-415f-b4cd-1de3c71e604d"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:11.997642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:09:11.997642 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:09:12.006915 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:12.007589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-c914986c-4f8b-4718-8c77-861eff97936c req-527f356e-7201-44d0-a57c-8ec5af9e92c6 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.008039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-c914986c-4f8b-4718-8c77-861eff97936c req-527f356e-7201-44d0-a57c-8ec5af9e92c6 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.008483 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:12.019602 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.020644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.021776 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.022463 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.031650 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.compute.server_external_events [req-c914986c-4f8b-4718-8c77-861eff97936c req-527f356e-7201-44d0-a57c-8ec5af9e92c6 service nova] Unable to find a host for instance 776bb0b5-5864-48f0-b212-af69708aae04. Dropping event network-vif-unplugged {{(pid=116226) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 13 23:09:12.032525 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-c914986c-4f8b-4718-8c77-861eff97936c req-527f356e-7201-44d0-a57c-8ec5af9e92c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041012 Dec 13 23:09:12.037180 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 519/1006] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 13 23:09:12.186330 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:12.197807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c047de80-8128-4e6f-98e1-e992486a0b3a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1520 microversion: 2.1 time: 0.195176 Dec 13 23:09:12.198752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 488/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:12 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:09:12.334310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4291d00b-f3b9-4429-b046-8cb9ebda1755 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:12.336488 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4291d00b-f3b9-4429-b046-8cb9ebda1755 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:12.341862 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4291d00b-f3b9-4429-b046-8cb9ebda1755 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.342537 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4291d00b-f3b9-4429-b046-8cb9ebda1755 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.343331 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4291d00b-f3b9-4429-b046-8cb9ebda1755 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.343768 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4291d00b-f3b9-4429-b046-8cb9ebda1755 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.375437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4291d00b-f3b9-4429-b046-8cb9ebda1755 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044847 Dec 13 23:09:12.376112 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 520/1008] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:09:12 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:12.640033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9bd50540-18df-4fed-a2f4-005d86b51e4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:12.641376 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9bd50540-18df-4fed-a2f4-005d86b51e4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:12.648752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bd50540-18df-4fed-a2f4-005d86b51e4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.649543 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bd50540-18df-4fed-a2f4-005d86b51e4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.650563 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bd50540-18df-4fed-a2f4-005d86b51e4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.651211 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9bd50540-18df-4fed-a2f4-005d86b51e4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.686807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9bd50540-18df-4fed-a2f4-005d86b51e4b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/8e78f5a2-5bbb-4ab1-a3a0-a5b1af71cd47" status: 200 len: 194 microversion: 2.1 time: 0.050502 Dec 13 23:09:12.687412 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 489/1009] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Dec 13 23:09:12 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/8e78f5a2-5bbb-4ab1-a3a0-a5b1af71cd47 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:12.697753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:12.698276 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:12.704422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.705089 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.705897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.706488 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.767962 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:12.768723 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:12.777800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.783189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.783189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:12.783863 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:12.810409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lazy-loading 'services' on Instance uuid e1c075a0-798e-4b28-89fd-64a75cc94a11 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:09:12.918455 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cc0ee0d3-6dcc-4092-aca8-268384f764c9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/8e78f5a2-5bbb-4ab1-a3a0-a5b1af71cd47" status: 202 len: 0 microversion: 2.1 time: 0.224186 Dec 13 23:09:12.919739 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 521/1010] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:09:12 2021] DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/8e78f5a2-5bbb-4ab1-a3a0-a5b1af71cd47 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:09:13.075937 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:13.092382 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:13.093966 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:13.095168 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-76417164-a947-488a-8431-1b75daa0b7dd tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.333266 Dec 13 23:09:13.101458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 490/1011] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:12 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:09:13.215300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:13.216712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:13.224247 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:13.224609 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:13.225181 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:13.225904 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:13.404401 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:13.412355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fb4d65ba-cd73-40ff-a59b-984925bf14bb tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.201133 Dec 13 23:09:13.413093 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 522/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:13 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:14.114118 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:14.115363 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:14.143194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:14.143605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:14.145684 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:14.146373 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:14.298554 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:14.308734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:14.310317 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:14.311742 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b532bac3-e728-4a20-b658-faa77dd59221 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.201759 Dec 13 23:09:14.323110 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 491/1013] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:14 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:14.432811 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:14.433386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:14.440238 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:14.440982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:14.442029 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:14.442668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:14.590685 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:14.601986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0ed2705f-220f-400c-a40a-a2ef45331ef2 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.172535 Dec 13 23:09:14.602832 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 523/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:14 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:15.145253 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0ea81103-5fe3-45dd-9d53-20d6c57cffc4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:15.147499 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0ea81103-5fe3-45dd-9d53-20d6c57cffc4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:15.155819 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ea81103-5fe3-45dd-9d53-20d6c57cffc4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.156352 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ea81103-5fe3-45dd-9d53-20d6c57cffc4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.157223 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ea81103-5fe3-45dd-9d53-20d6c57cffc4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.157779 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ea81103-5fe3-45dd-9d53-20d6c57cffc4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.193181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0ea81103-5fe3-45dd-9d53-20d6c57cffc4 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/a47a0a46-3fa0-4229-895f-a7df767a2872" status: 200 len: 194 microversion: 2.1 time: 0.051908 Dec 13 23:09:15.193807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 492/1015] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Dec 13 23:09:15 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/a47a0a46-3fa0-4229-895f-a7df767a2872 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:15.204084 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:15.204584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:15.210838 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.211288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.212095 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.212531 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.309205 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.objects.instance [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lazy-loading 'services' on Instance uuid e1c075a0-798e-4b28-89fd-64a75cc94a11 {{(pid=116226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:09:15.331149 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:15.332273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:15.338906 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.339428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.340524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.341063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.416689 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d53c601c-1b16-4220-8b9c-a8dc99fb1d60 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/a47a0a46-3fa0-4229-895f-a7df767a2872" status: 202 len: 0 microversion: 2.1 time: 0.214144 Dec 13 23:09:15.425152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 524/1016] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:09:15 2021] DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments/a47a0a46-3fa0-4229-895f-a7df767a2872 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:09:15.495355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:15.507510 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:15.509516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:15.511021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6bbc4b52-dc08-4c57-a3e9-3e5ccfdd56b5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.184000 Dec 13 23:09:15.511783 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 493/1017] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:15 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:15.621828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:15.622567 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:15.629150 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.629565 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.630338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:15.630952 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:15.772390 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:15.780630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-05817e2d-0b4c-4b97-a137-6491e8d8c678 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.163793 Dec 13 23:09:15.781475 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 525/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:15 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:16.532372 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:16.533958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:16.541973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.542425 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.543257 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.543690 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.660814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e7d2d35a-0636-474d-a05a-0e14bee97a99 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:16.666287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e7d2d35a-0636-474d-a05a-0e14bee97a99 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:16.678698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7d2d35a-0636-474d-a05a-0e14bee97a99 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.679183 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7d2d35a-0636-474d-a05a-0e14bee97a99 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.679985 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7d2d35a-0636-474d-a05a-0e14bee97a99 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.680422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e7d2d35a-0636-474d-a05a-0e14bee97a99 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.715622 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:16.723936 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:16.725624 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:16.726672 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-6b9d89a6-41fa-45dc-a189-fd8b78fa2495 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.200351 Dec 13 23:09:16.727655 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 494/1019] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:16 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:16.728687 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e7d2d35a-0636-474d-a05a-0e14bee97a99 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072503 Dec 13 23:09:16.729306 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 526/1020] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:09:16 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:09:16.796747 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:16.797604 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:16.804098 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.804616 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.805520 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.806065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.885991 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7db208be-44f5-4123-b30c-5b8eba04ffc1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:16.887249 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7db208be-44f5-4123-b30c-5b8eba04ffc1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:16.893493 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db208be-44f5-4123-b30c-5b8eba04ffc1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.894196 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db208be-44f5-4123-b30c-5b8eba04ffc1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.895166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db208be-44f5-4123-b30c-5b8eba04ffc1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.895749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7db208be-44f5-4123-b30c-5b8eba04ffc1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.928218 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7db208be-44f5-4123-b30c-5b8eba04ffc1 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046034 Dec 13 23:09:16.943021 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 527/1021] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:09:16 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 23:09:16.985262 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:16.990138 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:16.990647 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:16.992536 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9e2a43aa-fa6f-4de7-ac48-3a0ada08db12 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.199372 Dec 13 23:09:16.993287 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 495/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:16 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:16.996670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.997117 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:16.997928 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:16.998358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:17.024355 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Going to try to terminate instance {{(pid=116226) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:09:17.123864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-fc9472ab-068f-4f3d-86f0-e59660bb8c1b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 204 len: 0 microversion: 2.1 time: 0.136854 Dec 13 23:09:17.124704 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 528/1023] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:09:16 2021] DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:09:17.133711 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:17.134332 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:17.140449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:17.140901 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:17.141770 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:17.142203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:17.285343 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:17.293129 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-24b085b0-a6df-4751-9876-a6dc840988d7 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1673 microversion: 2.1 time: 0.164302 Dec 13 23:09:17.304014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 496/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:17 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:17.748310 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:17.749076 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:17.756887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:17.757366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:17.758127 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:17.758577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:17.894425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:17.903613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:17.905742 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:17.906939 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7356e1da-1929-4ffe-9df3-a257369d8bc2 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1737 microversion: 2.20 time: 0.164228 Dec 13 23:09:17.907497 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 529/1025] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:17 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:18.011295 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:18.011990 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:18.018833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:18.019280 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:18.020065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:18.020615 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:18.255037 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:18.265192 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-794d6165-e780-46f9-8602-78994d24d487 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.257980 Dec 13 23:09:18.265729 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 497/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:18 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:18.311561 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:18.312500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:18.318701 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:18.319353 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:18.320366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:18.320950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:18.527694 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:18.535637 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d727f898-9a4f-4b70-b0e7-5f535a962bb2 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1673 microversion: 2.1 time: 0.227751 Dec 13 23:09:18.536205 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 530/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:18 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:18.927293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:18.927883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:18.934291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:18.934767 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:18.935547 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:18.935983 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:19.067197 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:19.079309 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:19.081624 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:19.083411 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-055d9941-0522-4e9e-9b4e-b049ce0678ab tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1719 microversion: 2.20 time: 0.159959 Dec 13 23:09:19.084195 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 498/1028] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:18 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:19.283952 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:19.284546 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:19.291659 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:19.292133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:19.293031 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:19.293550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:19.541662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:19.550020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3597db8a-c48b-4a17-9ad4-4390fafc86f4 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.269364 Dec 13 23:09:19.550543 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 531/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:19 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:19.553661 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:19.554856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:19.561501 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:19.561954 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:19.562775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:19.563169 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:19.784183 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d43744f4884b27a0b5144142ca41bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2d4b93ea4c3aa626e1676d2d8adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:19.792604 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b4e65bdd-796a-47fa-83d6-c4ee186faee5 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 200 len: 1673 microversion: 2.1 time: 0.243185 Dec 13 23:09:19.793241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 499/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:19 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 1673 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:09:20.102705 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:20.103351 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:20.109770 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:20.110214 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:20.110994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:20.111630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:20.123509 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-34cb561f-0ae8-488d-99a6-e5624298f770 req-ba12dc9c-416c-44ff-9b58-7b30e8e7192f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c075a0-798e-4b28-89fd-64a75cc94a11", "name": "network-vif-deleted", "tag": "d9b70f80-b3ad-40cb-bf2c-629338553928"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:20.125973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:09:20.125973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:09:20.135761 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-34cb561f-0ae8-488d-99a6-e5624298f770 req-ba12dc9c-416c-44ff-9b58-7b30e8e7192f service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:20.136655 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-34cb561f-0ae8-488d-99a6-e5624298f770 req-ba12dc9c-416c-44ff-9b58-7b30e8e7192f service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:20.149105 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-34cb561f-0ae8-488d-99a6-e5624298f770 req-ba12dc9c-416c-44ff-9b58-7b30e8e7192f service nova] Creating event network-vif-deleted:d9b70f80-b3ad-40cb-bf2c-629338553928 for instance e1c075a0-798e-4b28-89fd-64a75cc94a11 on hv-cinder-79628 Dec 13 23:09:20.155134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-34cb561f-0ae8-488d-99a6-e5624298f770 req-ba12dc9c-416c-44ff-9b58-7b30e8e7192f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037246 Dec 13 23:09:20.156391 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 500/1031] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:09:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:20.271088 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:20.279800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:20.281294 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:20.282623 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3a0eb1d5-bb85-4cb1-a381-6c4b8a4fb13f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1719 microversion: 2.20 time: 0.184501 Dec 13 23:09:20.283247 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 532/1032] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:20 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:20.570406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:20.571706 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:20.580450 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:20.580950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:20.581964 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:20.582580 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:20.737614 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:20.746172 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f6f3c5f5-a04e-48e7-ba77-34329378645b tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.182139 Dec 13 23:09:20.746829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 501/1033] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:20 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:20.810992 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:20.811605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:20.818297 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:20.818747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:20.819539 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:20.820116 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:20.833988 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] HTTP exception thrown: Instance e1c075a0-798e-4b28-89fd-64a75cc94a11 could not be found. Dec 13 23:09:20.834596 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Returning 404 to user: Instance e1c075a0-798e-4b28-89fd-64a75cc94a11 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:09:20.835414 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4579a8d3-5dc2-4140-a358-ecfe42b0addf tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 404 len: 111 microversion: 2.1 time: 0.028220 Dec 13 23:09:20.835986 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 533/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:20 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:09:20.844525 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c9a3504e-58bb-4337-8db3-09f9ac58bc2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '.version_select at 0x7f039a0a0820>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:20.863625 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c9a3504e-58bb-4337-8db3-09f9ac58bc2b tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266308672" status: 202 len: 0 microversion: 2.1 time: 0.022744 Dec 13 23:09:20.864773 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 502/1035] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Dec 13 23:09:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266308672 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:09:21.302460 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:21.303166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:21.309718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.310178 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.311167 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.311814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.455046 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:21.463040 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:21.464526 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:21.465711 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-732f4557-94b5-4011-b2db-d0c49875112a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1662 microversion: 2.20 time: 0.167574 Dec 13 23:09:21.466274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 534/1036] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:21 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1662 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:21.484004 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5b535d0b-efc2-42b5-9957-350429d96ce3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b730660b-90f6-4c6f-a51f-3b1ed848ddb2"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:21.485032 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5b535d0b-efc2-42b5-9957-350429d96ce3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:21.490913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b535d0b-efc2-42b5-9957-350429d96ce3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.491526 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b535d0b-efc2-42b5-9957-350429d96ce3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.492549 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b535d0b-efc2-42b5-9957-350429d96ce3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.492980 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b535d0b-efc2-42b5-9957-350429d96ce3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.764450 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:21.766234 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:21.773302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.773927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.775117 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.775604 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.779169 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5b535d0b-efc2-42b5-9957-350429d96ce3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299206 Dec 13 23:09:21.779959 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 503/1037] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Dec 13 23:09:21 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 23:09:21.898458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c8d30102-ebfa-4ba4-af8b-a1729a6be966 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:21.898458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c8d30102-ebfa-4ba4-af8b-a1729a6be966 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:21.905852 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c8d30102-ebfa-4ba4-af8b-a1729a6be966 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.906311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c8d30102-ebfa-4ba4-af8b-a1729a6be966 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.907102 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c8d30102-ebfa-4ba4-af8b-a1729a6be966 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:21.907748 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c8d30102-ebfa-4ba4-af8b-a1729a6be966 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:21.935977 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:21.944819 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d173592d-bcee-4c98-a55f-5eef9cb58f8d tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.185016 Dec 13 23:09:21.959476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 535/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:21 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:09:21.990988 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-ecd97e3f-4984-46c1-846e-29c3ad914e41 req-6a23ead1-e76c-4e11-8ff7-afbaa6afcd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fdf52d-3f52-4676-8602-74d204bfc44a", "name": "network-vif-unplugged", "status": "completed", "tag": "0a5e01cf-66ab-49f7-9779-2dc2d108f971"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:21.994224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:09:21.994224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:09:22.001039 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-ecd97e3f-4984-46c1-846e-29c3ad914e41 req-6a23ead1-e76c-4e11-8ff7-afbaa6afcd36 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:22.001516 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-ecd97e3f-4984-46c1-846e-29c3ad914e41 req-6a23ead1-e76c-4e11-8ff7-afbaa6afcd36 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:22.012711 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.compute.server_external_events [req-ecd97e3f-4984-46c1-846e-29c3ad914e41 req-6a23ead1-e76c-4e11-8ff7-afbaa6afcd36 service nova] Unable to find a host for instance 94fdf52d-3f52-4676-8602-74d204bfc44a. Dropping event network-vif-unplugged {{(pid=116226) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 13 23:09:22.013621 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-ecd97e3f-4984-46c1-846e-29c3ad914e41 req-6a23ead1-e76c-4e11-8ff7-afbaa6afcd36 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026407 Dec 13 23:09:22.014202 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 536/1039] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:09:21 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 13 23:09:22.153764 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c8d30102-ebfa-4ba4-af8b-a1729a6be966 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-volume_attachments/b730660b-90f6-4c6f-a51f-3b1ed848ddb2" status: 202 len: 0 microversion: 2.20 time: 0.259830 Dec 13 23:09:22.154547 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 504/1040] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Dec 13 23:09:21 2021] DELETE /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-volume_attachments/b730660b-90f6-4c6f-a51f-3b1ed848ddb2 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 13 23:09:22.210892 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ffd82de2-9eae-4d3d-8cbe-11caadad5b8a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:22.211456 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ffd82de2-9eae-4d3d-8cbe-11caadad5b8a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:22.217783 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ffd82de2-9eae-4d3d-8cbe-11caadad5b8a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:22.218240 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ffd82de2-9eae-4d3d-8cbe-11caadad5b8a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:22.219007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ffd82de2-9eae-4d3d-8cbe-11caadad5b8a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:22.219432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ffd82de2-9eae-4d3d-8cbe-11caadad5b8a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:22.304632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ffd82de2-9eae-4d3d-8cbe-11caadad5b8a tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action" status: 202 len: 0 microversion: 2.20 time: 0.097312 Dec 13 23:09:22.305148 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 537/1041] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Dec 13 23:09:22 2021] POST /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:09:22.313292 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:22.313938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:22.320121 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:22.320740 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:22.321566 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:22.322004 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:22.622416 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:22.630064 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:22.631557 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:22.633615 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-acf97f49-1dce-4ad8-a6ba-027bff69d302 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1670 microversion: 2.20 time: 0.324013 Dec 13 23:09:22.634261 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 505/1042] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:22 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1670 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:22.963640 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:22.964307 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:22.970723 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:22.971179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:22.972217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:22.972657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:23.116136 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:23.124150 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a2087f8e-6965-4a6a-ba17-63266d29a4a8 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.165402 Dec 13 23:09:23.124719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 538/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:22 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:23.652139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:23.652854 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:23.659626 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:23.660077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:23.660865 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:23.661297 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:23.780887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:23.781541 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:23.787722 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:23.788232 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:23.789584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:23.790057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:23.806408 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] HTTP exception thrown: Instance e1c075a0-798e-4b28-89fd-64a75cc94a11 could not be found. Dec 13 23:09:23.807005 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Returning 404 to user: Instance e1c075a0-798e-4b28-89fd-64a75cc94a11 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:09:23.808045 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-08e83b73-5517-49b1-881b-e6261b623102 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 404 len: 111 microversion: 2.1 time: 0.030917 Dec 13 23:09:23.808747 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 539/1044] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:09:23 2021] DELETE /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:09:23.816430 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:23.817378 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: e1c075a0-798e-4b28-89fd-64a75cc94a11] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:23.824607 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:23.825136 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:23.826052 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:23.826589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:23.840845 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] HTTP exception thrown: Instance e1c075a0-798e-4b28-89fd-64a75cc94a11 could not be found. Dec 13 23:09:23.841735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Returning 404 to user: Instance e1c075a0-798e-4b28-89fd-64a75cc94a11 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:09:23.842645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-dba58e0a-cd01-49c3-93ee-77ded60d66d9 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11" status: 404 len: 111 microversion: 2.1 time: 0.029824 Dec 13 23:09:23.843462 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 540/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:23 2021] GET /compute/v2.1/servers/e1c075a0-798e-4b28-89fd-64a75cc94a11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:09:23.907315 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:23.919082 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:23.921014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:23.922963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-849d0799-8d8f-4722-bbf0-067f2c0c7576 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.274605 Dec 13 23:09:23.924097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 506/1046] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:23 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:24.044661 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-8b13ee92-252e-4f15-b3e2-c0bfe5b6b1c4 req-2556ac40-2dc5-4a48-9c80-b94aaa05c039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776bb0b5-5864-48f0-b212-af69708aae04", "name": "network-vif-plugged", "status": "completed", "tag": "e9a3ffe7-75df-415f-b4cd-1de3c71e604d"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:24.046848 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:09:24.046848 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:09:24.054914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-8b13ee92-252e-4f15-b3e2-c0bfe5b6b1c4 req-2556ac40-2dc5-4a48-9c80-b94aaa05c039 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:24.055611 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-8b13ee92-252e-4f15-b3e2-c0bfe5b6b1c4 req-2556ac40-2dc5-4a48-9c80-b94aaa05c039 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:24.066646 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-8b13ee92-252e-4f15-b3e2-c0bfe5b6b1c4 req-2556ac40-2dc5-4a48-9c80-b94aaa05c039 service nova] Creating event network-vif-plugged:e9a3ffe7-75df-415f-b4cd-1de3c71e604d for instance 776bb0b5-5864-48f0-b212-af69708aae04 on hv-cinder-79628 Dec 13 23:09:24.072235 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-8b13ee92-252e-4f15-b3e2-c0bfe5b6b1c4 req-2556ac40-2dc5-4a48-9c80-b94aaa05c039 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031180 Dec 13 23:09:24.072805 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 541/1047] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:09:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:09:24.142437 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:24.143116 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:24.149677 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:24.150123 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:24.150899 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:24.151327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:24.350731 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:24.358356 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3420787b-0d72-4982-ad86-c84c36c4d4c1 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.220019 Dec 13 23:09:24.358913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 507/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:24 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:24.951433 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:24.952669 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:24.971690 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:24.973379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:24.976037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:24.978087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:24.994635 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:24.995377 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:25.013067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:25.014235 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:25.015291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:25.015833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:25.034537 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] HTTP exception thrown: Instance ff8b680f-031a-4c92-b62f-cf4069ffec8f could not be found. Dec 13 23:09:25.035524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Returning 404 to user: Instance ff8b680f-031a-4c92-b62f-cf4069ffec8f could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:09:25.036568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9b5f6238-5097-49b8-80d3-047cd58edeaa tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 404 len: 111 microversion: 2.1 time: 0.049020 Dec 13 23:09:25.037920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 508/1049] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:09:24 2021] DELETE /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:09:25.046021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:25.046660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] [instance: ff8b680f-031a-4c92-b62f-cf4069ffec8f] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:25.053045 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:25.053898 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:25.055267 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:25.055948 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:25.074067 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] HTTP exception thrown: Instance ff8b680f-031a-4c92-b62f-cf4069ffec8f could not be found. Dec 13 23:09:25.074955 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] Returning 404 to user: Instance ff8b680f-031a-4c92-b62f-cf4069ffec8f could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:09:25.075933 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4bfe4a5e-6d35-4e55-869f-836d81574178 tempest-AttachVolumeTestJSON-36441708 tempest-AttachVolumeTestJSON-36441708-project] 10.222.0.13 "GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f" status: 404 len: 111 microversion: 2.1 time: 0.033987 Dec 13 23:09:25.076490 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 509/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:25 2021] GET /compute/v2.1/servers/ff8b680f-031a-4c92-b62f-cf4069ffec8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:09:25.180013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:25.189833 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:25.191878 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:25.193275 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ccd25ffc-9263-4a49-abb3-72d68141762e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.252876 Dec 13 23:09:25.194576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 542/1051] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:24 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:25.375625 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:25.376342 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:25.382775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:25.383503 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:25.384487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:25.385163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:25.567623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:25.583627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-618f1749-82c0-44db-b4b1-51d78de5f395 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.211665 Dec 13 23:09:25.593825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 510/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:25 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:26.213270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:26.213749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:26.219938 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:26.220393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:26.221183 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:26.221639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:26.381683 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:26.391220 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:26.392883 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:26.394125 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ea87be10-25e7-480b-94b7-007e75437f7c tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.185868 Dec 13 23:09:26.406598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 543/1053] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:26 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:26.610907 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:26.611728 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:26.618889 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:26.619456 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:26.620356 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:26.620881 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:26.779200 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:26.787064 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a12fd7a5-4e70-42d5-a11a-5ea9c91a8144 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.179850 Dec 13 23:09:26.787921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 511/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:26 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:27.415237 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:27.416761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:27.429358 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:27.431731 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:27.434945 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:27.435470 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:27.600572 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:27.608889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:27.610385 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:27.611840 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f2bdc98c-d682-4d1f-9c17-0bbe07edd8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.201518 Dec 13 23:09:27.623034 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 544/1055] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:27 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:27.810430 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:27.811181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:27.829316 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:27.829802 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:27.830613 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:27.831047 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:28.062638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:28.070564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-9067a46d-02f0-4a92-908d-0d7bbf6d09d3 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.263438 Dec 13 23:09:28.071164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 512/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:27 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:28.630451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:28.631176 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:28.638180 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:28.638718 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:28.639518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:28.639957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:28.850319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:28.862048 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:28.864189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:28.865873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8277f726-4834-4d7c-ace1-7de13d07ca06 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.238659 Dec 13 23:09:28.875608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 545/1057] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:28 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:29.089749 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:29.090904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:29.099007 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:29.099793 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:29.100938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:29.101571 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:29.358058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:29.365498 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7df52b8b-af6a-4af2-ae96-2b2eafbfeca7 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.281356 Dec 13 23:09:29.366139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 513/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:29 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:29.883851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:29.884569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:29.890993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:29.891498 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:29.892333 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:29.892893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:30.080419 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:30.089822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:30.091681 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:30.092969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6e2bff6e-3f47-46fc-a426-59dd34c1508e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.213084 Dec 13 23:09:30.094086 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 546/1059] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:29 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 23:09:30.382927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:30.383537 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:30.390482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:30.390921 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:30.391722 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:30.392112 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:30.567085 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:30.588591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bb372b64-a672-44c5-a760-bf29cf5d935a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.209873 Dec 13 23:09:30.591682 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 514/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:30 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:31.111720 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:31.112356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:31.118919 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:31.119348 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:31.120124 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:31.120554 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:31.288043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:31.297351 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:31.299437 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:31.310243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-471983e9-e50a-4f41-9955-f91cb3929056 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.202135 Dec 13 23:09:31.315575 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 547/1061] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:31 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:31.607480 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:31.608095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:31.614378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:31.614814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:31.615576 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:31.616000 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:31.759917 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:31.767505 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-58b6dd6e-e679-4373-be15-ee95ca5d7e32 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.163841 Dec 13 23:09:31.768085 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 515/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:31 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:32.335688 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:32.336399 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:32.343274 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:32.343720 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:32.344509 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:32.344913 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:32.484531 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:32.493653 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:32.495402 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:32.496894 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-7d61f628-28ea-4171-af1f-152b1cf7d3d3 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.165358 Dec 13 23:09:32.497851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 548/1063] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:32 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:32.785071 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:32.785704 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:32.792833 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:32.793388 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:32.794281 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:32.794820 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:32.972193 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:32.981257 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0ec3dd8c-71b6-421b-893c-94f829df810f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.199777 Dec 13 23:09:32.981960 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 516/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:32 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:33.517134 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:33.517988 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:33.524599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:33.525050 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:33.525880 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:33.526313 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:33.665256 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:33.674157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:33.676013 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:33.677179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e0854376-f5f9-4295-8f40-9e38a1daa776 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.164014 Dec 13 23:09:33.677762 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 549/1065] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:33 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:33.998762 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:34.000612 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:34.007639 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:34.008136 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:34.009107 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:34.009561 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:34.158134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:34.167036 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cea312e9-348d-4444-8e71-d63d4760ff6c tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.172013 Dec 13 23:09:34.167707 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 517/1066] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:33 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:34.696874 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:34.697619 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:34.704259 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:34.704836 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:34.705786 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:34.706608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:34.876693 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:34.886697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:34.888891 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:34.890558 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c2da6b9d-1d1c-4315-a61b-98bbd84c27aa tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.197189 Dec 13 23:09:34.903278 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 550/1067] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:34 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:35.185214 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:35.186790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:35.193568 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:35.194078 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:35.195184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:35.195679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:35.372375 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:35.380340 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-853dc6f2-c15c-401d-9bb1-4824aa45918a tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.198870 Dec 13 23:09:35.380913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 518/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:35 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:35.910132 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:35.910797 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:35.917624 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:35.918152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:35.919004 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:35.919495 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:36.048190 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:36.056972 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:36.058563 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:36.059765 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-74877c31-0ca0-42c8-b649-9fcaffcf543f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.153342 Dec 13 23:09:36.070828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 551/1069] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:35 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:36.396979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:36.397635 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:36.404348 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:36.404703 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:36.405527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:36.405958 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:36.543536 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:36.557698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4dc711c0-9272-4f1c-9bc9-179588514976 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1576 microversion: 2.1 time: 0.164392 Dec 13 23:09:36.558639 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 519/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:36 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:37.078329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:37.079083 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:37.085962 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:37.086432 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:37.087190 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:37.087627 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:37.222162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:37.230982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:37.232466 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:37.233671 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b97af7e5-d5d6-45ac-9ecb-1c0519c7034e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.159285 Dec 13 23:09:37.234252 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 552/1071] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:37 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:37.575309 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:37.576133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:37.585774 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:37.586231 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:37.587014 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:37.587439 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:37.723433 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:37.731398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0de24c36-be51-4abf-9bde-4d5c4dd20926 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1563 microversion: 2.1 time: 0.159753 Dec 13 23:09:37.731961 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 520/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:09:37 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:09:38.252072 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:38.252631 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:38.258991 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:38.260073 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:38.260861 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:38.261289 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:38.429380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:38.437443 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:38.438996 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:38.440213 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b1ac8cae-e2de-4233-92fa-1b7aa41a05a4 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.191935 Dec 13 23:09:38.440997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 553/1073] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:38 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:39.459083 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:39.459671 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:39.467396 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:39.467965 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:39.469163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:39.469765 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:39.600859 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:39.609234 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:39.610760 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:39.611920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-12d895c2-de9c-49a9-b341-1182baacfbbb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.156572 Dec 13 23:09:39.612457 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 521/1074] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:39 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:40.630062 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:40.630659 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:40.637772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:40.638224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:40.639014 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:40.639449 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:40.771425 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:40.779351 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:40.780834 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:40.782041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-77084066-da9f-400f-89ba-06f2e7cfa266 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.155948 Dec 13 23:09:40.782582 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 554/1075] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:40 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:41.804925 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:41.806358 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:41.817092 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:41.817872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:41.819159 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:41.819877 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:41.963932 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:41.972006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:41.973630 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:41.974802 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-93bcc18e-b464-4169-9133-9a339d427957 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.176550 Dec 13 23:09:41.975326 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 522/1076] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:41 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:42.029818 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-19e511fe-15fb-49a7-93c6-58a2b77ba56d req-34d4d117-637f-40f3-8fd8-9915abd3671d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fdf52d-3f52-4676-8602-74d204bfc44a", "name": "network-vif-plugged", "status": "completed", "tag": "0a5e01cf-66ab-49f7-9779-2dc2d108f971"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:09:42.031454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:09:42.031454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:09:42.039652 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-19e511fe-15fb-49a7-93c6-58a2b77ba56d req-34d4d117-637f-40f3-8fd8-9915abd3671d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:42.040368 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-19e511fe-15fb-49a7-93c6-58a2b77ba56d req-34d4d117-637f-40f3-8fd8-9915abd3671d service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:42.052509 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-19e511fe-15fb-49a7-93c6-58a2b77ba56d req-34d4d117-637f-40f3-8fd8-9915abd3671d service nova] Creating event network-vif-plugged:0a5e01cf-66ab-49f7-9779-2dc2d108f971 for instance 94fdf52d-3f52-4676-8602-74d204bfc44a on hv-cinder-79628 Dec 13 23:09:42.058105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-19e511fe-15fb-49a7-93c6-58a2b77ba56d req-34d4d117-637f-40f3-8fd8-9915abd3671d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032917 Dec 13 23:09:42.059104 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 555/1077] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:09:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:09:42.994178 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:42.994792 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:43.001832 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:43.002282 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:43.003066 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:43.003491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:43.138737 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:43.147185 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:43.148659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:43.149866 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7061a804-a05d-44bf-a896-58a31da6736e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.160348 Dec 13 23:09:43.150511 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 523/1078] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:42 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:44.170840 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:44.171519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:44.178538 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:44.178981 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:44.179744 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:44.180167 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:44.328809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:44.337608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:44.339103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:44.340248 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e837a3be-0358-4b25-a07d-360036280327 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.174078 Dec 13 23:09:44.340809 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 556/1079] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:44 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:45.361909 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:45.362637 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:45.373154 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:45.373620 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:45.374468 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:45.374898 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:45.504033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:45.512212 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:45.513626 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:45.514787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1253a10a-60a2-46b3-abad-4fbae48abd88 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.156796 Dec 13 23:09:45.515343 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 524/1080] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:45 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:46.532143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:46.532744 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:46.539430 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:46.539889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:46.540643 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:46.541067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:46.673562 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:46.688307 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:46.689823 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:46.690990 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a76eec4a-8290-46ac-bd1b-ea82150bb431 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1728 microversion: 2.20 time: 0.162572 Dec 13 23:09:46.691550 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 557/1081] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:46 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:09:47.710151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:09:47.710719 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:09:47.717696 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:47.718143 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:47.718922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:09:47.719355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:09:47.871868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:47.880544 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:47.882088 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:09:47.883249 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-4a960ce9-cd4a-4209-b866-0448ddb2679e tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1715 microversion: 2.20 time: 0.176930 Dec 13 23:09:47.883808 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 525/1082] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:09:47 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1715 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:10:20.776160 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-2f22986c-5933-49f9-bf38-06d40b15bd64 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:20.777300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-2f22986c-5933-49f9-bf38-06d40b15bd64 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:20.785398 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f22986c-5933-49f9-bf38-06d40b15bd64 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:20.785893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f22986c-5933-49f9-bf38-06d40b15bd64 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:20.786645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f22986c-5933-49f9-bf38-06d40b15bd64 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:20.787072 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-2f22986c-5933-49f9-bf38-06d40b15bd64 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:20.816311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-2f22986c-5933-49f9-bf38-06d40b15bd64 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046347 Dec 13 23:10:20.817069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 558/1083] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Dec 13 23:10:20 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:20.885880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:20.886417 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:20.895207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:20.895648 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:20.896676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:20.897213 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:20.926913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:10:21.008772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b267e438-e2a8-444d-88de-45df454a68d1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 204 len: 0 microversion: 2.20 time: 0.128621 Dec 13 23:10:21.009823 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 526/1084] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Dec 13 23:10:20 2021] DELETE /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 23:10:21.018690 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:21.019295 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:21.025753 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:21.026204 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:21.026978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:21.027435 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:21.166459 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:21.175222 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:21.176717 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:21.177967 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-77ab64f5-d2f0-4f54-a37a-72eb7021a66d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.163624 Dec 13 23:10:21.178533 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 559/1085] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:10:21 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:10:22.200789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:22.201985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:22.210092 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:22.210611 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:22.211319 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:22.211752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:22.390173 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:22.398984 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:22.400470 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:22.401660 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c2fed354-dfc2-4957-a2d0-ae67e7ac1be1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1721 microversion: 2.20 time: 0.207665 Dec 13 23:10:22.402422 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 527/1086] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:10:22 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:10:23.244800 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-f865804c-0bbd-4ee9-8d1a-2c2521257e96 req-30840868-7218-4e7d-8ff7-6042067550f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94fdf52d-3f52-4676-8602-74d204bfc44a", "name": "network-vif-deleted", "tag": "0a5e01cf-66ab-49f7-9779-2dc2d108f971"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:10:23.246426 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:10:23.246426 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:10:23.255566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-f865804c-0bbd-4ee9-8d1a-2c2521257e96 req-30840868-7218-4e7d-8ff7-6042067550f8 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:23.256007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-f865804c-0bbd-4ee9-8d1a-2c2521257e96 req-30840868-7218-4e7d-8ff7-6042067550f8 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:23.267446 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-f865804c-0bbd-4ee9-8d1a-2c2521257e96 req-30840868-7218-4e7d-8ff7-6042067550f8 service nova] Creating event network-vif-deleted:0a5e01cf-66ab-49f7-9779-2dc2d108f971 for instance 94fdf52d-3f52-4676-8602-74d204bfc44a on hv-cinder-79628 Dec 13 23:10:23.272548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-f865804c-0bbd-4ee9-8d1a-2c2521257e96 req-30840868-7218-4e7d-8ff7-6042067550f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Dec 13 23:10:23.273141 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 560/1087] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:10:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:23.422424 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:23.423716 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:23.430964 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:23.431418 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:23.432287 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:23.432728 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:23.467675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:23.468151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:23.468605 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lazy-loading 'fault' on Instance uuid 94fdf52d-3f52-4676-8602-74d204bfc44a {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:10:23.510554 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:23.519411 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:23.521057 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa225c572d14800b77943c1902833b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff275d4e81c547e4b1d09435f41a51a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:23.522290 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-907a5962-0986-4c63-ba62-850895d6d2a1 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 200 len: 1369 microversion: 2.20 time: 0.103640 Dec 13 23:10:23.522846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 528/1088] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:10:23 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 23:10:24.546793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:24.547771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:24.558783 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:24.559512 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:24.560769 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:24.561529 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:24.576014 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] HTTP exception thrown: Instance 94fdf52d-3f52-4676-8602-74d204bfc44a could not be found. Dec 13 23:10:24.576587 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Returning 404 to user: Instance 94fdf52d-3f52-4676-8602-74d204bfc44a could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:10:24.577420 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-615f2c86-98a1-4a17-9232-92c2c3abc8e5 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 404 len: 111 microversion: 2.20 time: 0.038494 Dec 13 23:10:24.577945 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 561/1089] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:10:24 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:10:24.586558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8cc7f02c-9490-45d8-98b2-e1459196a865 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '.version_select at 0x7f039a0e8160>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:24.607573 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8cc7f02c-9490-45d8-98b2-e1459196a865 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451469398" status: 204 len: 0 microversion: 2.20 time: 0.024684 Dec 13 23:10:24.608169 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 529/1090] 10.222.0.13 () {60 vars in 1258 bytes} [Mon Dec 13 23:10:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451469398 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 23:10:26.399697 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:26.400224 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:26.407124 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:26.407558 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:26.408356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:26.408787 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:26.424519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] HTTP exception thrown: Instance 94fdf52d-3f52-4676-8602-74d204bfc44a could not be found. Dec 13 23:10:26.425161 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Returning 404 to user: Instance 94fdf52d-3f52-4676-8602-74d204bfc44a could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:10:26.426191 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8defb17c-70d7-4f00-b817-836fd8ebe32d tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 404 len: 111 microversion: 2.20 time: 0.030337 Dec 13 23:10:26.426719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 562/1091] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Dec 13 23:10:26 2021] DELETE /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:10:26.435283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:26.435892 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 94fdf52d-3f52-4676-8602-74d204bfc44a] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:26.442696 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:26.443150 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:26.443931 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:26.444369 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:26.458151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] HTTP exception thrown: Instance 94fdf52d-3f52-4676-8602-74d204bfc44a could not be found. Dec 13 23:10:26.458739 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Returning 404 to user: Instance 94fdf52d-3f52-4676-8602-74d204bfc44a could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:10:26.459553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-471c1ae1-5f93-490d-9924-90cdfdae6f77 tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a" status: 404 len: 111 microversion: 2.20 time: 0.028554 Dec 13 23:10:26.460074 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 530/1092] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:10:26 2021] GET /compute/v2.1/servers/94fdf52d-3f52-4676-8602-74d204bfc44a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:10:27.602407 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:27.602946 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:27.609584 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:27.610028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:27.610791 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:27.611223 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:27.624624 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] HTTP exception thrown: Instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 could not be found. Dec 13 23:10:27.625476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Returning 404 to user: Instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:10:27.626110 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b9fe3efa-b68d-4680-a7c1-cc478fec3a0f tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "DELETE /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 404 len: 111 microversion: 2.20 time: 0.027929 Dec 13 23:10:27.626641 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 563/1093] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Dec 13 23:10:27 2021] DELETE /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:10:27.635481 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:27.636081 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] [instance: 168526af-2c4e-4e84-8b87-7f2e71d96e16] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:27.642687 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:27.643126 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:27.643891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:27.644317 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:27.658199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] HTTP exception thrown: Instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 could not be found. Dec 13 23:10:27.658765 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] Returning 404 to user: Instance 168526af-2c4e-4e84-8b87-7f2e71d96e16 could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:10:27.659564 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e67daea1-db68-4876-9fcf-2a7c1b2e1ccb tempest-AttachVolumeShelveTestJSON-1541323004 tempest-AttachVolumeShelveTestJSON-1541323004-project] 10.222.0.13 "GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16" status: 404 len: 111 microversion: 2.20 time: 0.027806 Dec 13 23:10:27.660069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 531/1094] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Dec 13 23:10:27 2021] GET /compute/v2.1/servers/168526af-2c4e-4e84-8b87-7f2e71d96e16 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 23:10:33.708906 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-62b51aa2-2503-4183-be2c-04b8e384c943 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a15bd30>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:33.767463 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-62b51aa2-2503-4183-be2c-04b8e384c943 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/32e60645-8df2-4ea2-ba1e-7d1e38871348" status: 200 len: 351 microversion: 2.1 time: 0.062534 Dec 13 23:10:33.768028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 564/1095] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:10:33 2021] GET /compute/v2.1/os-volumes/32e60645-8df2-4ea2-ba1e-7d1e38871348 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:35.108291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-753f63c3-2a93-4ebf-9a96-6b345dc00355 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a09e040>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:35.162414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-753f63c3-2a93-4ebf-9a96-6b345dc00355 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3cf8b788-7961-4b3c-87e7-07f405132377" status: 200 len: 351 microversion: 2.1 time: 0.059951 Dec 13 23:10:35.162977 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 532/1096] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:10:35 2021] GET /compute/v2.1/os-volumes/3cf8b788-7961-4b3c-87e7-07f405132377 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:36.309138 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:10:36.309902 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: Mon Dec 13 23:10:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:10:36.502603 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-85f3cde9-3b06-4ff4-b260-b00236eec799 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a0de430>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:36.551362 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-85f3cde9-3b06-4ff4-b260-b00236eec799 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9f312bd3-7134-4415-a2c5-9d90897f0229" status: 200 len: 351 microversion: 2.1 time: 0.052804 Dec 13 23:10:36.552190 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 565/1097] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Dec 13 23:10:36 2021] GET /compute/v2.1/os-volumes/9f312bd3-7134-4415-a2c5-9d90897f0229 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:36.563939 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5ae03164-805e-42f1-ad91-968c55e5e6e6 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a0e8700>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:36.643969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5ae03164-805e-42f1-ad91-968c55e5e6e6 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084209 Dec 13 23:10:36.644527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 533/1098] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Dec 13 23:10:36 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:36.656613 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-39250ea0-835b-4df8-8a60-e8c01b5980e0 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a024700>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:36.737628 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-39250ea0-835b-4df8-8a60-e8c01b5980e0 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084180 Dec 13 23:10:36.738386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 566/1099] 10.222.0.13 () {58 vars in 1148 bytes} [Mon Dec 13 23:10:36 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:36.750869 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-a843f7f2-d52e-413b-a902-8440f4d88af9 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a08e1f0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:36.829770 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-a843f7f2-d52e-413b-a902-8440f4d88af9 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082359 Dec 13 23:10:36.830325 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 534/1100] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Dec 13 23:10:36 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:36.841561 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-da5d9e1a-910c-4a93-aef2-9793b013ed3d tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a068670>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:36.929470 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-da5d9e1a-910c-4a93-aef2-9793b013ed3d tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091421 Dec 13 23:10:36.930044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 567/1101] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Dec 13 23:10:36 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:36.944825 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-227cbe01-d7ae-4780-90d7-d179c9d039f6 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a11b310>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:37.031204 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-227cbe01-d7ae-4780-90d7-d179c9d039f6 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090251 Dec 13 23:10:37.031802 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 535/1102] 10.222.0.13 () {58 vars in 1169 bytes} [Mon Dec 13 23:10:36 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:37.043731 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ea52e7bf-8f47-413f-98b6-f56143bea9d6 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a074ca0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:37.138952 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ea52e7bf-8f47-413f-98b6-f56143bea9d6 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.098827 Dec 13 23:10:37.139519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 568/1103] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Dec 13 23:10:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:37.150888 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-121f307e-d8c7-4d12-8fb8-00e51647d301 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a0db0d0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:37.238800 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-121f307e-d8c7-4d12-8fb8-00e51647d301 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091347 Dec 13 23:10:37.239371 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 536/1104] 10.222.0.13 () {58 vars in 1187 bytes} [Mon Dec 13 23:10:37 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:37.250959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-c72a5ace-d471-4a18-a727-6410cf5c2329 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] Calling method '.version_select at 0x7f039a0740d0>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:37.330771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-c72a5ace-d471-4a18-a727-6410cf5c2329 tempest-VolumesTestJSON-185007043 tempest-VolumesTestJSON-185007043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083339 Dec 13 23:10:37.331362 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 569/1105] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Dec 13 23:10:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:54.832271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:54.832872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:54.837305 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-cec8a576-92b0-4429-9d88-08beed745b07 req-e0c92908-a463-4050-a26b-41c674c3695a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776bb0b5-5864-48f0-b212-af69708aae04", "tag": "e9a3ffe7-75df-415f-b4cd-1de3c71e604d"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:10:54.838984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:10:54.838984 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:10:54.839676 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:54.840246 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:54.841300 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:54.841962 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:54.847074 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-cec8a576-92b0-4429-9d88-08beed745b07 req-e0c92908-a463-4050-a26b-41c674c3695a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:54.847520 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-cec8a576-92b0-4429-9d88-08beed745b07 req-e0c92908-a463-4050-a26b-41c674c3695a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:54.858280 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-cec8a576-92b0-4429-9d88-08beed745b07 req-e0c92908-a463-4050-a26b-41c674c3695a service nova] Creating event network-changed:e9a3ffe7-75df-415f-b4cd-1de3c71e604d for instance 776bb0b5-5864-48f0-b212-af69708aae04 on hv-cinder-79628 Dec 13 23:10:54.863951 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-cec8a576-92b0-4429-9d88-08beed745b07 req-e0c92908-a463-4050-a26b-41c674c3695a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030901 Dec 13 23:10:54.865260 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 570/1106] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:10:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:54.868026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:10:54.948189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f99534ef-6719-4ebc-afeb-e7c083c9a111 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 204 len: 0 microversion: 2.1 time: 0.120382 Dec 13 23:10:54.948675 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 537/1107] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:10:54 2021] DELETE /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:10:54.958472 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:54.959764 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:54.967128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:54.967707 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:54.968579 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:54.969081 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:55.108157 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:55.116422 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-598061d7-e4f5-4d63-9a2d-71d9cee863de tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1569 microversion: 2.1 time: 0.162896 Dec 13 23:10:55.117007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 571/1108] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:54 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:56.070477 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:56.071309 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:56.081642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:56.082090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:56.082883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:56.083314 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:56.119383 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:10:56.135761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:56.136709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:56.143588 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:56.144154 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:56.145009 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:56.145482 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:56.200185 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-79d969f9-03a0-41c0-8c46-228277c5f413 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 204 len: 0 microversion: 2.1 time: 0.136322 Dec 13 23:10:56.201179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 538/1109] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:10:56 2021] DELETE /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 13 23:10:56.210517 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:56.211196 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:56.217355 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:56.217852 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:56.218637 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:56.219075 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:56.311317 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:56.319170 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8bb0613c-505a-4535-baf0-c9246a15ba61 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1451 microversion: 2.1 time: 0.187230 Dec 13 23:10:56.319741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 572/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:56 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1451 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:56.381043 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:56.393397 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7c5df07b-696b-4bac-b23f-8cdf48deba71 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1578 microversion: 2.1 time: 0.186551 Dec 13 23:10:56.394335 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 539/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:56 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:57.336167 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:57.336781 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:57.343440 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:57.343886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:57.344707 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:57.345371 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:57.366846 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-37a3636b-d3dc-4f7b-92a8-514f5eeb86ad req-ffb39850-89eb-4f9d-96f0-cac920e681bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776bb0b5-5864-48f0-b212-af69708aae04", "name": "network-vif-deleted", "tag": "e9a3ffe7-75df-415f-b4cd-1de3c71e604d"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:10:57.368451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:10:57.368451 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:10:57.376639 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-37a3636b-d3dc-4f7b-92a8-514f5eeb86ad req-ffb39850-89eb-4f9d-96f0-cac920e681bb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:57.377108 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-37a3636b-d3dc-4f7b-92a8-514f5eeb86ad req-ffb39850-89eb-4f9d-96f0-cac920e681bb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:57.391322 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-37a3636b-d3dc-4f7b-92a8-514f5eeb86ad req-ffb39850-89eb-4f9d-96f0-cac920e681bb service nova] Creating event network-vif-deleted:e9a3ffe7-75df-415f-b4cd-1de3c71e604d for instance 776bb0b5-5864-48f0-b212-af69708aae04 on hv-cinder-79628 Dec 13 23:10:57.397366 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-37a3636b-d3dc-4f7b-92a8-514f5eeb86ad req-ffb39850-89eb-4f9d-96f0-cac920e681bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034610 Dec 13 23:10:57.398575 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 540/1112] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:10:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:57.413762 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:57.414814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:57.422446 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:57.422854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ed484d62ab45fea26e324f737e231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd4dc022cad44d1baaa51931dfdfa31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:57.422987 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:57.423649 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:57.424495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:57.431122 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bc01f4aa-af88-4a76-aabf-cf6a3d23688f tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 200 len: 1383 microversion: 2.1 time: 0.098581 Dec 13 23:10:57.432269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 573/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:57 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 1383 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:57.568775 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:57.578049 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-cf4422d4-5f13-470f-a326-a96477221ddf tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1578 microversion: 2.1 time: 0.168306 Dec 13 23:10:57.578923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 541/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:57 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:10:58.448530 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:58.449481 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] [instance: 776bb0b5-5864-48f0-b212-af69708aae04] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:58.456341 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:58.456886 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:58.457680 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:58.458102 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:58.471446 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] HTTP exception thrown: Instance 776bb0b5-5864-48f0-b212-af69708aae04 could not be found. Dec 13 23:10:58.472037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Returning 404 to user: Instance 776bb0b5-5864-48f0-b212-af69708aae04 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:10:58.472890 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-d83e99fd-4ea8-4461-a58d-2564afc1e219 tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04" status: 404 len: 111 microversion: 2.1 time: 0.028313 Dec 13 23:10:58.473417 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 574/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:58 2021] GET /compute/v2.1/servers/776bb0b5-5864-48f0-b212-af69708aae04 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:10:58.595780 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:58.597434 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:58.603924 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:58.604584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:58.605573 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:58.606153 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:58.641123 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-eb1f3ac5-6575-49a9-83d4-ac5fd5e9dfbc tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] Calling method '.version_select at 0x7f039aa28a60>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:58.678387 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:58.681443 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-eb1f3ac5-6575-49a9-83d4-ac5fd5e9dfbc tempest-TestShelveInstance-1012621367 tempest-TestShelveInstance-1012621367-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2137429673" status: 202 len: 0 microversion: 2.1 time: 0.045111 Dec 13 23:10:58.682107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 575/1116] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Dec 13 23:10:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2137429673 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:10:58.692527 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1cd7fa43-d3f9-4cf8-b487-89bc0c0fedef tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1511 microversion: 2.1 time: 0.100306 Dec 13 23:10:58.693642 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 542/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:58 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:10:59.415306 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-9317a521-e63f-4eba-af9e-66d55b824c44 req-fdf0109b-110e-4425-acf3-c6ac49b4ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e689912f-fc16-4bf4-8ec3-c7c312c41fb9", "name": "network-vif-deleted", "tag": "6b8fadde-582e-4953-a8a1-5cdaca48e38c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:10:59.416863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:10:59.416863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:10:59.425242 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-9317a521-e63f-4eba-af9e-66d55b824c44 req-fdf0109b-110e-4425-acf3-c6ac49b4ff32 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:59.425708 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-9317a521-e63f-4eba-af9e-66d55b824c44 req-fdf0109b-110e-4425-acf3-c6ac49b4ff32 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:59.436445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-9317a521-e63f-4eba-af9e-66d55b824c44 req-fdf0109b-110e-4425-acf3-c6ac49b4ff32 service nova] Creating event network-vif-deleted:6b8fadde-582e-4953-a8a1-5cdaca48e38c for instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 on hv-cinder-79628 Dec 13 23:10:59.441893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-9317a521-e63f-4eba-af9e-66d55b824c44 req-fdf0109b-110e-4425-acf3-c6ac49b4ff32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030248 Dec 13 23:10:59.442605 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 576/1118] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:10:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:10:59.710795 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:10:59.711410 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:10:59.718378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:59.718829 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:59.719606 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:10:59.720051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:10:59.796359 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:10:59.805457 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2a2af157-e356-47ac-aa82-967844d1f2b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1225 microversion: 2.1 time: 0.098409 Dec 13 23:10:59.805878 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 543/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:10:59 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:00.823620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:00.825044 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:00.831513 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:00.831956 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:00.832728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:00.833152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:00.908633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:00.916864 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e6800aed-f676-47fa-a84c-66313038c08b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 200 len: 1225 microversion: 2.1 time: 0.097655 Dec 13 23:11:00.917855 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 577/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:00 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:01.935337 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:01.935975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:01.947858 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:01.948219 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:01.949237 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:01.949792 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:01.967435 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] HTTP exception thrown: Instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 could not be found. Dec 13 23:11:01.968370 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Returning 404 to user: Instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:11:01.969203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-918024f4-a7d2-4420-a067-0187ab5e5ce6 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 404 len: 111 microversion: 2.1 time: 0.038194 Dec 13 23:11:01.969963 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 544/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:01 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:11:02.079851 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1017098639", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-757443627", "security_groups": [{"name": "tempest-secgroup-smoke-862593000"}], "block_device_mapping_v2": [{"uuid": "91938485-636d-45a7-95ef-bb8d2db13590", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6646f8aa-a5ae-40b1-af43-1c8579efe381"}]}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:11:02.257701 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.network.neutron [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] validate_networks() for [('6646f8aa-a5ae-40b1-af43-1c8579efe381', None, None, None, None, None)] {{(pid=116226) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:11:02.719088 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Flavor limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:11:02.719509 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Image limits 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:11:02.719980 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Flavor pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:11:02.720416 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Image pref 0:0:0 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:11:02.720843 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.virt.hardware [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:11:02.729906 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:02.730484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:02.731317 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:02.731780 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:02.748387 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:11:02.752693 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for user 33969662112e43f6a1c3dd76d70deca4 and project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'cores', 'ram', 'instances'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:11:02.809814 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Going to run 1 instances... {{(pid=116226) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:11:02.812379 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91938485-636d-45a7-95ef-bb8d2db13590',volume_size=None,volume_type=None)] {{(pid=116226) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:11:02.946504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e6986e06-4fb2-4059-9c4a-77545040db63 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.869996 Dec 13 23:11:02.947119 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 578/1122] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:11:02 2021] POST /compute/v2.1/servers => generated 405 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:11:02.967814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b7a768f4-b90d-4f84-b61f-7f61af677dc0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:02.968365 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b7a768f4-b90d-4f84-b61f-7f61af677dc0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:03.032877 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b7a768f4-b90d-4f84-b61f-7f61af677dc0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:03.039406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b7a768f4-b90d-4f84-b61f-7f61af677dc0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1094 microversion: 2.1 time: 0.078636 Dec 13 23:11:03.040341 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 545/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:02 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:04.056830 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:04.058265 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:04.065266 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:04.065766 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:04.066576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:04.067001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:04.311020 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:04.318716 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1b285ec6-00b9-4f97-90d5-fcb1bc8ea539 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1192 microversion: 2.1 time: 0.266285 Dec 13 23:11:04.319488 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 579/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:04 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1192 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:05.335981 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:05.336584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:05.344199 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:05.344651 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:05.345507 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:05.345969 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:05.404945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:05.412468 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-1cde1bd9-9f78-49b3-8a42-a7f6337cd392 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1192 microversion: 2.1 time: 0.080259 Dec 13 23:11:05.412990 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 546/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:05 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1192 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:06.429362 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:06.430000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:06.436315 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:06.436780 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:06.437589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:06.438007 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:06.500657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:06.508126 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8cf960bf-5729-406d-a238-9ec19aa5239b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1192 microversion: 2.1 time: 0.082438 Dec 13 23:11:06.509212 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 580/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:06 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:07.525940 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:07.526812 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:07.534231 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:07.534733 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:07.535773 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:07.536208 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:07.763556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:07.777020 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7f82eb3e-75a0-48a1-a267-aaec1c13eb91 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.254933 Dec 13 23:11:07.778557 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 547/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:07 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:08.088214 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-b79b0f71-c57a-450a-b7a1-047160e940c2 req-9a248fa1-f5bc-44d6-8d8a-c2e9ec7b01f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede3bf14-ee3f-40c0-b84b-fcae9c5b698c", "tag": "c2f938ec-d363-431e-b58d-e8c5029dc15c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:11:08.089982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:11:08.089982 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:11:08.097970 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b79b0f71-c57a-450a-b7a1-047160e940c2 req-9a248fa1-f5bc-44d6-8d8a-c2e9ec7b01f1 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:08.098786 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-b79b0f71-c57a-450a-b7a1-047160e940c2 req-9a248fa1-f5bc-44d6-8d8a-c2e9ec7b01f1 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:08.122344 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-b79b0f71-c57a-450a-b7a1-047160e940c2 req-9a248fa1-f5bc-44d6-8d8a-c2e9ec7b01f1 service nova] Creating event network-changed:c2f938ec-d363-431e-b58d-e8c5029dc15c for instance ede3bf14-ee3f-40c0-b84b-fcae9c5b698c on hv-cinder-79628 Dec 13 23:11:08.128129 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-b79b0f71-c57a-450a-b7a1-047160e940c2 req-9a248fa1-f5bc-44d6-8d8a-c2e9ec7b01f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043490 Dec 13 23:11:08.129096 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 581/1128] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:11:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:11:08.794283 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:08.794973 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:08.801869 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:08.802312 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:08.803061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:08.803485 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:09.010781 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:09.019923 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-02587c6e-32d9-4319-97e0-4b912bcc4701 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.229718 Dec 13 23:11:09.020500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 548/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:08 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:10.037906 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:10.038603 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:10.045625 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:10.046057 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:10.046829 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:10.047289 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:10.188246 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:10.195989 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-0f048b00-82aa-4260-850c-a338a83caf29 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.162682 Dec 13 23:11:10.196558 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 582/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:10 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:11.216855 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:11.217524 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:11.225237 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:11.225793 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:11.226757 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:11.227258 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:11.371097 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:11.379702 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7280d83a-80ca-4d6e-878c-bfec10c7e222 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.169011 Dec 13 23:11:11.380268 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 549/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:11 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:12.397471 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:12.398130 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:12.405448 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:12.405908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:12.406883 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:12.407318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:12.622863 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:12.631938 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ae262ffc-6f70-4755-bdd3-a7d31549e9e1 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.239172 Dec 13 23:11:12.632940 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 583/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:12 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:13.650368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:13.650957 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:13.657163 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:13.657632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:13.658406 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:13.658840 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:13.804110 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:13.813143 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-30d9d66a-635e-4d6f-88fb-7eae28360dd4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.166290 Dec 13 23:11:13.813952 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 550/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:13 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:14.830860 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:14.831478 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:14.838549 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:14.838994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:14.839779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:14.840312 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:14.983482 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:14.991978 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bcbbd3cc-34d3-4fef-8bfe-9ee3f22785a5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.165075 Dec 13 23:11:14.992159 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 584/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:14 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:16.008516 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:16.009123 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:16.015978 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:16.016403 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:16.017180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:16.017674 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:16.153313 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:16.161001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0c3a63ed-15e6-425b-b245-e629ce9651c2 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.156239 Dec 13 23:11:16.163006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 551/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:16 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:17.179170 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:17.179719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:17.187686 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:17.188134 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:17.188917 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:17.189375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:17.330957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:17.341842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-953f161c-6ece-40de-9231-b05e8db4f117 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.166638 Dec 13 23:11:17.342413 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 585/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:17 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:17.748543 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-064be479-bd39-4444-be4b-0806be4211bd req-93be5c0f-2a81-418d-b667-983bfe25af68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede3bf14-ee3f-40c0-b84b-fcae9c5b698c", "name": "network-vif-plugged", "status": "completed", "tag": "c2f938ec-d363-431e-b58d-e8c5029dc15c"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:11:17.750609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:11:17.750609 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:11:17.759908 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-064be479-bd39-4444-be4b-0806be4211bd req-93be5c0f-2a81-418d-b667-983bfe25af68 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:17.761596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-064be479-bd39-4444-be4b-0806be4211bd req-93be5c0f-2a81-418d-b667-983bfe25af68 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:17.775004 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-064be479-bd39-4444-be4b-0806be4211bd req-93be5c0f-2a81-418d-b667-983bfe25af68 service nova] Creating event network-vif-plugged:c2f938ec-d363-431e-b58d-e8c5029dc15c for instance ede3bf14-ee3f-40c0-b84b-fcae9c5b698c on hv-cinder-79628 Dec 13 23:11:17.780653 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-064be479-bd39-4444-be4b-0806be4211bd req-93be5c0f-2a81-418d-b667-983bfe25af68 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036502 Dec 13 23:11:17.781691 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 552/1137] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:11:18.361369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:18.362003 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:18.368906 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:18.369370 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:18.370161 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:18.370654 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:18.513393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:18.524375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-56363b03-55dd-4f17-b108-9a6e7e45b6fb tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1265 microversion: 2.1 time: 0.168165 Dec 13 23:11:18.524960 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 586/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:18 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:19.544405 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:19.546107 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:19.554100 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:19.554578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:19.555368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:19.555807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:19.622436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:11:19.623058 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: Mon Dec 13 23:11:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c (ip 10.222.0.13) !!! Dec 13 23:11:19.694013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:19.701589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-144c8c66-c900-4140-a24f-083d5d0af10e tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1453 microversion: 2.1 time: 0.161726 Dec 13 23:11:19.702227 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 553/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:19 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:19.721848 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:11:19.722460 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:11:19.728645 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:19.729087 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:19.729934 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:19.730372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:19.866712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:11:19.874172 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6c653331-d8eb-4787-9541-922378f85fa8 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1453 microversion: 2.1 time: 0.156620 Dec 13 23:11:19.874776 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 587/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:11:19 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:11:21.868164 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-d6440492-edac-488a-8d35-11a01a2def6c req-84431f0b-c6b6-47ae-abdf-ef0a02faa5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede3bf14-ee3f-40c0-b84b-fcae9c5b698c", "tag": "c2f938ec-d363-431e-b58d-e8c5029dc15c"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:11:21.869567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:11:21.869567 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:11:21.879588 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-d6440492-edac-488a-8d35-11a01a2def6c req-84431f0b-c6b6-47ae-abdf-ef0a02faa5ee service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:11:21.879588 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-d6440492-edac-488a-8d35-11a01a2def6c req-84431f0b-c6b6-47ae-abdf-ef0a02faa5ee service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:11:21.892180 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-d6440492-edac-488a-8d35-11a01a2def6c req-84431f0b-c6b6-47ae-abdf-ef0a02faa5ee service nova] Creating event network-changed:c2f938ec-d363-431e-b58d-e8c5029dc15c for instance ede3bf14-ee3f-40c0-b84b-fcae9c5b698c on hv-cinder-79628 Dec 13 23:11:21.897724 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-d6440492-edac-488a-8d35-11a01a2def6c req-84431f0b-c6b6-47ae-abdf-ef0a02faa5ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034237 Dec 13 23:11:21.898381 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 554/1141] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:11:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:12:27.227311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-bdbbceb0-30b3-4431-882c-b0f36a5df44e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Action: 'create', calling method: .version_select at 0x7f039a1cf3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1907949425"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:12:27.241395 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-bdbbceb0-30b3-4431-882c-b0f36a5df44e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Getting quotas for project 32fb7851fcdf4c988491b5239cbeb015. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:12:27.245548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-bdbbceb0-30b3-4431-882c-b0f36a5df44e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Getting quotas for user 3b320ab11a3e42b9bb329f72347f6ec2 and project 32fb7851fcdf4c988491b5239cbeb015. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:12:27.381742 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-bdbbceb0-30b3-4431-882c-b0f36a5df44e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Getting quotas for project 32fb7851fcdf4c988491b5239cbeb015. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:12:27.385789 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.quota [None req-bdbbceb0-30b3-4431-882c-b0f36a5df44e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Getting quotas for user 3b320ab11a3e42b9bb329f72347f6ec2 and project 32fb7851fcdf4c988491b5239cbeb015. Resources: {'key_pairs'} {{(pid=116226) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:12:27.398476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-bdbbceb0-30b3-4431-882c-b0f36a5df44e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.176443 Dec 13 23:12:27.399370 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 588/1142] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Dec 13 23:12:27 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:12:27.451421 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-905634826", "imageRef": "07205394-e9dc-48ac-9ef1-3a787326e152", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1907949425", "networks": [{"uuid": "970bc77d-4239-473c-881b-40835e5cdec5"}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:12:27.507955 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] validate_networks() for [('970bc77d-4239-473c-881b-40835e5cdec5', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:12:27.890008 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:12:27.890343 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:12:27.890814 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:12:27.891222 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:12:27.891629 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:12:27.901358 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:27.901804 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:27.902613 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:27.903041 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:27.919681 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Getting quotas for project 32fb7851fcdf4c988491b5239cbeb015. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:12:27.923950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Getting quotas for user 3b320ab11a3e42b9bb329f72347f6ec2 and project 32fb7851fcdf4c988491b5239cbeb015. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:12:27.935367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:12:27.937754 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07205394-e9dc-48ac-9ef1-3a787326e152',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:12:27.990540 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0c1bc970-fb5d-4446-bd70-f8128b722bab tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544347 Dec 13 23:12:27.991500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 555/1143] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:12:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:12:28.001473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f9e58c7c-805f-43b3-a27e-d59017edd6c8 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:28.002240 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f9e58c7c-805f-43b3-a27e-d59017edd6c8 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:28.065037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f9e58c7c-805f-43b3-a27e-d59017edd6c8 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:28.071719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f9e58c7c-805f-43b3-a27e-d59017edd6c8 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1258 microversion: 2.1 time: 0.074036 Dec 13 23:12:28.072291 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 589/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:27 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:29.088950 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:29.090104 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:29.098126 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:29.098569 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:29.099347 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:29.099782 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:29.163616 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:29.171572 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3d91ceef-65f8-40f6-9b53-943abfd172a6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1316 microversion: 2.1 time: 0.086328 Dec 13 23:12:29.172577 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 556/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:29 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:30.189889 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:30.190878 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:30.199105 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:30.199579 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:30.200555 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:30.201023 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:30.335447 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:30.343143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b95668c2-22b6-47dd-8775-c02e4e5b0d7a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.157310 Dec 13 23:12:30.343727 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 590/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:30 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:31.360303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:31.360905 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:31.367541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:31.367993 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:31.368778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:31.369204 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:31.515334 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:31.522786 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d46251e7-8cdd-494c-b764-b15132601541 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.166303 Dec 13 23:12:31.523402 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 557/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:31 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:32.542360 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:32.542969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:32.550723 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:32.551264 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:32.552133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:32.552630 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:32.684082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:32.691738 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-14a4d137-bf54-49c2-a8cd-89d8ccd4b438 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.154058 Dec 13 23:12:32.692393 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 591/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:32 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:33.708072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:33.708670 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:33.716123 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:33.716574 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:33.717394 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:33.717831 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:33.853920 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:33.861182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ea12fdaa-f187-4436-ae30-de524dcfd64b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.156871 Dec 13 23:12:33.861779 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 558/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:33 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:34.878858 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:34.879462 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:34.888957 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:34.889451 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:34.890258 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:34.890752 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:35.044101 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:35.054288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-80789d23-32c1-4f22-8f74-22c621084133 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.179116 Dec 13 23:12:35.055085 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 592/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:34 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:36.071919 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:36.072615 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:36.079237 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:36.079698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:36.080435 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:36.080864 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:36.241727 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:36.249219 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-fe0b0ea4-1a99-4a6b-94eb-8872283b098e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.181095 Dec 13 23:12:36.249807 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 559/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:36 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:37.271312 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:37.272182 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:37.283881 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:37.285046 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:37.287504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:37.287504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:37.443118 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:37.451466 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-a8a7dbb5-2051-4367-8d8f-79a44cfd4252 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.186647 Dec 13 23:12:37.452037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 593/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:37 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:38.473789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:38.475151 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:38.484095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:38.484541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:38.485358 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:38.485798 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:38.625554 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:38.633582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0f45a95e-c7c2-4c5a-824f-2f7c834f98de tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.166312 Dec 13 23:12:38.634368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 560/1153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:38 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:39.652347 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:39.652959 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:39.659856 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:39.660299 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:39.661072 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:39.661536 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:39.805639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:39.815177 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-38909145-1d58-4a6b-82fb-09ca16bc6aa6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.167354 Dec 13 23:12:39.815785 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 594/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:39 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:40.831939 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:40.832523 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:40.839620 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:40.840070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:40.840872 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:40.841314 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:40.947338 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-5ac08953-2e16-4209-971f-06317a6fcf8a req-f90af72f-5de7-4ee6-af76-98dc25c8773a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd70637-7df5-414a-9d47-5569359290fa", "tag": "7d9199d5-570c-4348-b9fd-c69073779c2c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:12:40.952054 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:12:40.952054 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:12:40.962698 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5ac08953-2e16-4209-971f-06317a6fcf8a req-f90af72f-5de7-4ee6-af76-98dc25c8773a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:40.963364 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-5ac08953-2e16-4209-971f-06317a6fcf8a req-f90af72f-5de7-4ee6-af76-98dc25c8773a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:40.975875 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-5ac08953-2e16-4209-971f-06317a6fcf8a req-f90af72f-5de7-4ee6-af76-98dc25c8773a service nova] Creating event network-changed:7d9199d5-570c-4348-b9fd-c69073779c2c for instance cfd70637-7df5-414a-9d47-5569359290fa on hv-cinder-79628 Dec 13 23:12:40.983522 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-5ac08953-2e16-4209-971f-06317a6fcf8a req-f90af72f-5de7-4ee6-af76-98dc25c8773a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048704 Dec 13 23:12:40.984446 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 595/1155] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:12:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:12:41.072458 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:41.080495 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-f6f4dfdc-1518-4a5f-8703-aded45c2e60b tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.252145 Dec 13 23:12:41.081070 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 561/1156] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:40 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:42.103435 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:42.104873 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:42.115300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:42.116032 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:42.117302 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:42.118061 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:42.257576 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:42.265524 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-b23f00a2-8499-49e9-8440-544a7ffcde7e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.169547 Dec 13 23:12:42.266089 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 596/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:42 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:43.283702 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:43.284320 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:43.292487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:43.292999 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:43.294013 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:43.294442 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:43.443871 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:43.451475 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-694286cc-7dcf-4681-951c-214d78a5408a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.172246 Dec 13 23:12:43.452006 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 562/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:43 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:44.469741 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:44.470388 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:44.478607 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:44.479170 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:44.480265 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:44.480721 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:44.612072 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:44.619406 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ec0783de-cf7f-463b-8826-326b41132eed tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.154516 Dec 13 23:12:44.619969 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 597/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:44 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:45.641774 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:45.642789 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:45.653494 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:45.653941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:45.654725 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:45.655153 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:45.804124 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:45.812549 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7d3934b5-7300-40fe-9e71-dca41cb7db8d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.178248 Dec 13 23:12:45.813117 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 563/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:45 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:46.220919 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-ad39c227-a89d-42d2-bcbe-1a43fad1765b req-91ddf222-d278-4127-9920-2c1087c22cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd70637-7df5-414a-9d47-5569359290fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d9199d5-570c-4348-b9fd-c69073779c2c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:12:46.222392 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:12:46.222392 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:12:46.229749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-ad39c227-a89d-42d2-bcbe-1a43fad1765b req-91ddf222-d278-4127-9920-2c1087c22cef service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:46.230179 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-ad39c227-a89d-42d2-bcbe-1a43fad1765b req-91ddf222-d278-4127-9920-2c1087c22cef service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:46.243244 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-ad39c227-a89d-42d2-bcbe-1a43fad1765b req-91ddf222-d278-4127-9920-2c1087c22cef service nova] Creating event network-vif-plugged:7d9199d5-570c-4348-b9fd-c69073779c2c for instance cfd70637-7df5-414a-9d47-5569359290fa on hv-cinder-79628 Dec 13 23:12:46.250369 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-ad39c227-a89d-42d2-bcbe-1a43fad1765b req-91ddf222-d278-4127-9920-2c1087c22cef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033425 Dec 13 23:12:46.251455 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 598/1161] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:12:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:12:46.833803 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:46.834808 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:46.843189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:46.843645 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:46.844429 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:46.844863 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:46.983339 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:46.991112 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-19489301-572e-44cf-9e64-7e25fea8b6ee tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1358 microversion: 2.1 time: 0.163545 Dec 13 23:12:46.991681 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 564/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:46 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:48.009357 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:48.010078 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:48.016903 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.017360 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.018143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.018570 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.160318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:48.168012 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-53f2b38c-b175-4a5c-8512-2cc05e48a7e1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1548 microversion: 2.1 time: 0.162912 Dec 13 23:12:48.168572 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 599/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:48 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:48.184945 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:48.185673 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:48.192328 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.192778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.193578 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.194033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.336090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:48.345270 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b2144f56-ce34-4d27-8dc3-f301d9c4626d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1548 microversion: 2.1 time: 0.164340 Dec 13 23:12:48.345877 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 565/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:48 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:48.361169 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:48.364815 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:12:48.364815 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:12:48.366001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:48.366749 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Searching by: {'deleted': False, 'project_id': '32fb7851fcdf4c988491b5239cbeb015'} {{(pid=116226) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 13 23:12:48.374024 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.374473 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.375282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.375715 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.464316 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.multi_cell_list [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116226) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 13 23:12:48.560519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f5a5c392-d8bd-43a2-b8f1-97fa94c0d005 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202797 Dec 13 23:12:48.561022 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 600/1165] 10.222.0.13 () {58 vars in 1124 bytes} [Mon Dec 13 23:12:48 2021] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:12:48.574367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:48.574981 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:48.581271 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.581740 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.582514 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:48.582943 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:48.726541 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:48.734241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7c634e13-7b60-42c9-af5e-9ec80176cc6a tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1548 microversion: 2.1 time: 0.166159 Dec 13 23:12:48.734778 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 566/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:48 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:50.281750 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-65dafe71-beec-4bb5-96c5-8cefa66f07af tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8faa9e2c-1f2f-482b-8454-961676078faf"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:12:50.283599 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-65dafe71-beec-4bb5-96c5-8cefa66f07af tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:50.290632 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65dafe71-beec-4bb5-96c5-8cefa66f07af tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:50.291094 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65dafe71-beec-4bb5-96c5-8cefa66f07af tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:50.291898 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65dafe71-beec-4bb5-96c5-8cefa66f07af tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:50.292325 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-65dafe71-beec-4bb5-96c5-8cefa66f07af tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:50.539480 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-65dafe71-beec-4bb5-96c5-8cefa66f07af tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262137 Dec 13 23:12:50.540107 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 601/1167] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Dec 13 23:12:50 2021] POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:12:57.083380 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:12:57.084033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:12:57.090444 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:57.090890 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:57.091667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:57.092095 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:57.234928 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:12:57.243535 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ddacc2d9-1d10-4839-9a48-d0554806e3d2 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1594 microversion: 2.1 time: 0.163899 Dec 13 23:12:57.244102 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 567/1168] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:12:57 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:12:59.213561 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-2c3a7fc4-ab20-4b60-9291-83086e4dd0c6 req-4d281829-be04-4e2a-86a1-d509cc3b4c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd70637-7df5-414a-9d47-5569359290fa", "tag": "7d9199d5-570c-4348-b9fd-c69073779c2c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:12:59.215166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:12:59.215166 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:12:59.223606 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-2c3a7fc4-ab20-4b60-9291-83086e4dd0c6 req-4d281829-be04-4e2a-86a1-d509cc3b4c18 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:12:59.224041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-2c3a7fc4-ab20-4b60-9291-83086e4dd0c6 req-4d281829-be04-4e2a-86a1-d509cc3b4c18 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:12:59.236428 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-2c3a7fc4-ab20-4b60-9291-83086e4dd0c6 req-4d281829-be04-4e2a-86a1-d509cc3b4c18 service nova] Creating event network-changed:7d9199d5-570c-4348-b9fd-c69073779c2c for instance cfd70637-7df5-414a-9d47-5569359290fa on hv-cinder-79628 Dec 13 23:12:59.242069 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-2c3a7fc4-ab20-4b60-9291-83086e4dd0c6 req-4d281829-be04-4e2a-86a1-d509cc3b4c18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032687 Dec 13 23:12:59.243412 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 602/1169] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:12:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:13:00.130181 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1184173127"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:13:00.130836 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:00.137547 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:00.138071 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:00.138927 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:00.139419 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:00.391610 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.network.security_group_api [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Adding security group cf0c29b5-9278-4d56-b7b1-7f9d4e74f7db to port 7d9199d5-570c-4348-b9fd-c69073779c2c Dec 13 23:13:00.758553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bb051236-9e09-484f-9336-629d75c94829 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/action" status: 202 len: 0 microversion: 2.1 time: 0.632390 Dec 13 23:13:00.759653 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 568/1170] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:13:00 2021] POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:13:00.768950 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:00.770205 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-52ce2c69-e948-426b-9474-3991e3b2fd75 req-09cc8abd-51a1-43a9-9499-2e3e59c599bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd70637-7df5-414a-9d47-5569359290fa", "tag": "7d9199d5-570c-4348-b9fd-c69073779c2c"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:13:00.770566 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:00.772207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:13:00.772207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:13:00.780615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:00.781050 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-52ce2c69-e948-426b-9474-3991e3b2fd75 req-09cc8abd-51a1-43a9-9499-2e3e59c599bb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:00.781185 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:00.781772 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-52ce2c69-e948-426b-9474-3991e3b2fd75 req-09cc8abd-51a1-43a9-9499-2e3e59c599bb service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:00.781893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:00.782313 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:00.794891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-52ce2c69-e948-426b-9474-3991e3b2fd75 req-09cc8abd-51a1-43a9-9499-2e3e59c599bb service nova] Creating event network-changed:7d9199d5-570c-4348-b9fd-c69073779c2c for instance cfd70637-7df5-414a-9d47-5569359290fa on hv-cinder-79628 Dec 13 23:13:00.806087 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-52ce2c69-e948-426b-9474-3991e3b2fd75 req-09cc8abd-51a1-43a9-9499-2e3e59c599bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040048 Dec 13 23:13:00.806697 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 569/1171] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:13:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:13:01.066092 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:01.075136 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-37cdea4b-68da-4373-b71e-75410694a769 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1641 microversion: 2.1 time: 0.310356 Dec 13 23:13:01.075709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 603/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:00 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1641 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:04.953214 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-302494685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-757443627", "security_groups": [{"name": "tempest-secgroup-smoke-862593000"}], "block_device_mapping_v2": [{"uuid": "36e84aa9-a784-4f0f-b111-d675240b2209", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6646f8aa-a5ae-40b1-af43-1c8579efe381"}]}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:13:05.076329 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.network.neutron [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] validate_networks() for [('6646f8aa-a5ae-40b1-af43-1c8579efe381', None, None, None, None, None)] {{(pid=116225) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 23:13:05.526837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Flavor limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 23:13:05.527251 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Image limits 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 23:13:05.527719 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Flavor pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 23:13:05.528116 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Image pref 0:0:0 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 23:13:05.528539 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.virt.hardware [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116225) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 23:13:05.538344 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:05.538790 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:05.539595 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:05.540011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:05.557472 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 23:13:05.561835 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.quota [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Getting quotas for user 33969662112e43f6a1c3dd76d70deca4 and project d41d0a6cbf194f8c89c606ddb13feecb. Resources: {'cores', 'ram', 'instances'} {{(pid=116225) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 23:13:05.618298 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Going to run 1 instances... {{(pid=116225) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 23:13:05.620545 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36e84aa9-a784-4f0f-b111-d675240b2209',volume_size=None,volume_type=None)] {{(pid=116225) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 23:13:05.758447 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0fbbf1ab-1487-4832-a35f-7395cb91695a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809722 Dec 13 23:13:05.759086 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 570/1173] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Dec 13 23:13:04 2021] POST /compute/v2.1/servers => generated 405 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 23:13:05.769577 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-85d03710-9a1f-4b68-b382-89d1e9e13c92 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:05.770318 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-85d03710-9a1f-4b68-b382-89d1e9e13c92 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:05.823840 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-85d03710-9a1f-4b68-b382-89d1e9e13c92 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:05.831312 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-85d03710-9a1f-4b68-b382-89d1e9e13c92 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1093 microversion: 2.1 time: 0.065968 Dec 13 23:13:05.832152 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 604/1174] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:05 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:06.851238 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:06.851918 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:06.859851 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:06.860343 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:06.861139 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:06.861594 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:07.214436 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:07.224699 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-bcafd252-d43f-4a84-9f5b-e75ba41cb07b tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1209 microversion: 2.1 time: 0.379936 Dec 13 23:13:07.225254 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 571/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:06 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1209 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:08.242480 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:08.243184 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:08.250226 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:08.250670 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:08.251444 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:08.252147 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:08.400303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-96a5fd53-12ef-48ca-ac9e-12b4e8152c10 req-67275133-2695-4d5d-88d9-c47ce6496319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677ba26f-6428-422b-9a02-9910c221aa02", "tag": "4f9609b0-e000-4526-a95a-49b5d2e8dabb"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:13:08.404734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:13:08.404734 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:13:08.419659 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-96a5fd53-12ef-48ca-ac9e-12b4e8152c10 req-67275133-2695-4d5d-88d9-c47ce6496319 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:08.420091 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-96a5fd53-12ef-48ca-ac9e-12b4e8152c10 req-67275133-2695-4d5d-88d9-c47ce6496319 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:08.458648 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-96a5fd53-12ef-48ca-ac9e-12b4e8152c10 req-67275133-2695-4d5d-88d9-c47ce6496319 service nova] Creating event network-changed:4f9609b0-e000-4526-a95a-49b5d2e8dabb for instance 677ba26f-6428-422b-9a02-9910c221aa02 on hv-cinder-79628 Dec 13 23:13:08.467033 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-96a5fd53-12ef-48ca-ac9e-12b4e8152c10 req-67275133-2695-4d5d-88d9-c47ce6496319 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070330 Dec 13 23:13:08.467953 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 572/1176] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:13:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:13:08.575916 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:08.583511 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-07dfa10b-5433-49aa-b1d5-7ec7f9b22af0 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.345767 Dec 13 23:13:08.584221 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 605/1177] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:08 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:09.601069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:09.601812 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:09.607852 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:09.608299 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:09.609069 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:09.609522 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:09.829134 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:09.837303 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-12dbdd41-7b05-4ea6-85b9-5959fb27f286 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.240802 Dec 13 23:13:09.837904 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 573/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:09 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:10.857745 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:10.858751 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:10.867695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:10.868142 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:10.868927 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:10.869380 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:11.009242 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:11.016795 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-886ff005-0e49-484f-b267-6bc6e027aa45 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.165239 Dec 13 23:13:11.017272 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 606/1179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:10 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:12.043487 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:12.044241 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:12.052311 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:12.052837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:12.053799 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:12.054318 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:12.194210 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:12.202021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2bf71a9a-fc3f-4a8c-8b0c-90e8983a9970 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.162986 Dec 13 23:13:12.202553 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 574/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:12 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:13.220657 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:13.221399 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:13.229854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:13.230374 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:13.231269 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:13.231773 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:13.374706 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:13.382757 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e20992f3-dec8-4140-9224-11193aa72624 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.166576 Dec 13 23:13:13.383337 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 607/1181] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:13 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:14.404194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:14.405176 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:14.414677 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:14.415117 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:14.415899 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:14.416332 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:14.568966 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:14.577700 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d16eded8-ce41-4e43-a1cc-9057e1800291 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.179893 Dec 13 23:13:14.578284 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 575/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:14 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:15.603067 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:15.604206 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:15.614942 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:15.615467 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:15.616256 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:15.616696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:15.761939 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:15.772639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1d9a9167-5c2f-4a04-a1f2-0a8771d73063 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.175681 Dec 13 23:13:15.773390 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 608/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:15 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:16.791995 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:16.792698 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:16.800877 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:16.801469 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:16.802491 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:16.803027 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:16.945293 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:16.956891 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-c069e8c8-402c-4fb3-aafd-a5514550f0e7 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.169233 Dec 13 23:13:16.957733 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 576/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:16 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:17.976733 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:17.977381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:17.984117 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:17.984560 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:17.985385 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:17.985802 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:18.124709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:18.132995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-ab1f5a63-2f9e-48ed-a05e-3d68e9164c32 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.161921 Dec 13 23:13:18.133598 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 609/1185] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:17 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:19.142714 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-ad41a32f-e667-4629-9f42-ebcb129bf852 req-8246ec88-3384-4993-b1c1-b2478b8972cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677ba26f-6428-422b-9a02-9910c221aa02", "name": "network-vif-plugged", "status": "completed", "tag": "4f9609b0-e000-4526-a95a-49b5d2e8dabb"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:13:19.144342 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:13:19.144342 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:13:19.151000 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:19.152617 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:19.152756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-ad41a32f-e667-4629-9f42-ebcb129bf852 req-8246ec88-3384-4993-b1c1-b2478b8972cd service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:19.152756 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-ad41a32f-e667-4629-9f42-ebcb129bf852 req-8246ec88-3384-4993-b1c1-b2478b8972cd service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:19.159119 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:19.159556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:19.160381 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:19.160844 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:19.164490 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-ad41a32f-e667-4629-9f42-ebcb129bf852 req-8246ec88-3384-4993-b1c1-b2478b8972cd service nova] Creating event network-vif-plugged:4f9609b0-e000-4526-a95a-49b5d2e8dabb for instance 677ba26f-6428-422b-9a02-9910c221aa02 on hv-cinder-79628 Dec 13 23:13:19.169741 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-ad41a32f-e667-4629-9f42-ebcb129bf852 req-8246ec88-3384-4993-b1c1-b2478b8972cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030737 Dec 13 23:13:19.170552 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 577/1186] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:13:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:13:19.303072 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:19.310475 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f24a9a4b-3d89-458e-aad9-ca0ffe5ba1a3 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.163773 Dec 13 23:13:19.311046 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 610/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:19 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:20.332001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:20.333239 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:20.344258 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:20.344997 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:20.346401 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:20.347077 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:20.492634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:20.500470 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-46353644-bb20-4fe8-8807-e5342e90e634 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1264 microversion: 2.1 time: 0.175972 Dec 13 23:13:20.501039 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 578/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:20 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:21.521193 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:21.521822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:21.528596 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:21.529041 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:21.529857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:21.530288 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:21.675884 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:21.687282 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1af109ed-fae1-4717-b3f1-3040a62cf720 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1451 microversion: 2.1 time: 0.171805 Dec 13 23:13:21.688042 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 611/1189] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:21 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:21.762393 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:21.763011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:21.769781 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:21.770330 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:21.771216 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:21.771623 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:21.924207 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:21.932165 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-41d74649-25a8-41f5-aafa-6d889d4f2d0a tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1451 microversion: 2.1 time: 0.231816 Dec 13 23:13:21.932720 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 579/1190] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:21 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:23.521093 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-56e33699-1e9e-4186-86ba-26495174dbd5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:13:23.522082 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-56e33699-1e9e-4186-86ba-26495174dbd5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:23.528853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56e33699-1e9e-4186-86ba-26495174dbd5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:23.529304 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56e33699-1e9e-4186-86ba-26495174dbd5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:23.530128 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56e33699-1e9e-4186-86ba-26495174dbd5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:23.530571 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-56e33699-1e9e-4186-86ba-26495174dbd5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:23.607971 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-56e33699-1e9e-4186-86ba-26495174dbd5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/action" status: 202 len: 0 microversion: 2.1 time: 0.090622 Dec 13 23:13:23.608858 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 612/1191] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:13:23 2021] POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:13:23.618349 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:23.619550 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:23.626449 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:23.626922 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:23.627880 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:23.628503 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:24.003604 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:24.013063 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-23290d4a-b3fe-4fd2-83aa-e2b5810b5557 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1751 microversion: 2.1 time: 0.399613 Dec 13 23:13:24.013913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 580/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:23 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1751 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:13:24.118345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-302e6e69-84f5-4bf9-b655-2fcace3bc4ad req-748f9b2f-5512-4b34-88e6-08ed126c446a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677ba26f-6428-422b-9a02-9910c221aa02", "tag": "4f9609b0-e000-4526-a95a-49b5d2e8dabb"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:13:24.120418 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:13:24.120418 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:13:24.128799 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-302e6e69-84f5-4bf9-b655-2fcace3bc4ad req-748f9b2f-5512-4b34-88e6-08ed126c446a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:24.129772 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-302e6e69-84f5-4bf9-b655-2fcace3bc4ad req-748f9b2f-5512-4b34-88e6-08ed126c446a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:24.141298 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-302e6e69-84f5-4bf9-b655-2fcace3bc4ad req-748f9b2f-5512-4b34-88e6-08ed126c446a service nova] Creating event network-changed:4f9609b0-e000-4526-a95a-49b5d2e8dabb for instance 677ba26f-6428-422b-9a02-9910c221aa02 on hv-cinder-79628 Dec 13 23:13:24.147367 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-302e6e69-84f5-4bf9-b655-2fcace3bc4ad req-748f9b2f-5512-4b34-88e6-08ed126c446a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033205 Dec 13 23:13:24.148300 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 613/1193] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:13:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:13:25.031560 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:25.032223 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:25.039157 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:25.039608 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:25.041089 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:25.041566 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:25.194233 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:25.202174 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-5b2e7033-522c-4823-9eeb-a7eecfb652ec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.174629 Dec 13 23:13:25.202732 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 581/1194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:25 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:26.225329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:26.226708 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:26.238411 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:26.239079 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:26.240286 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:26.241093 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:26.398679 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:26.411089 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-beb8abfc-00bc-4916-a866-0bbe0b3770bf tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.192889 Dec 13 23:13:26.411893 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 614/1195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:26 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:27.438016 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:27.439073 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:27.447823 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:27.448273 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:27.449053 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:27.449519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:27.600462 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:27.608398 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7696aa7b-cad0-47b9-803f-10b516a4f0a7 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.176650 Dec 13 23:13:27.608941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 582/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:27 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:28.635838 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:28.636828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:28.648356 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:28.648828 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:28.649612 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:28.650046 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:28.802341 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:28.814010 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f7d4b3a6-68d5-4158-823d-ab130a123fec tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.184892 Dec 13 23:13:28.814764 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 615/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:28 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:29.832432 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:29.833090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:29.840473 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:29.840971 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:29.841794 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:29.842279 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:29.995582 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:30.007666 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-48f17f0f-00c3-49a3-a3cc-bd773461e063 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.178926 Dec 13 23:13:30.008400 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 583/1198] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:29 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:31.031249 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:31.031853 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:31.039362 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:31.039854 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:31.040668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:31.041144 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:31.204070 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:31.216793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f0f13868-db11-498b-892b-4072b8e8f13d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.189387 Dec 13 23:13:31.217470 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 616/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:31 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:32.237530 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:32.238384 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:32.246021 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:32.246470 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:32.247245 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:32.247674 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:32.409665 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:32.421403 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0a6e3ffd-d985-4111-b89a-37283f55332f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.189844 Dec 13 23:13:32.422178 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 584/1200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:32 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:33.442268 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:33.442865 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:33.450091 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:33.450537 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:33.451304 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:33.451734 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:33.609211 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:33.622053 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-13fe7cd8-a3b6-47a4-b40c-882e1117dae9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.183143 Dec 13 23:13:33.622837 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 617/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:33 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:34.643912 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:34.644979 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:34.653009 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:34.653500 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:34.654305 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:34.654752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:34.800913 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:34.809262 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-8d501ee9-fa7a-42e0-afc9-80fcaf2a5715 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.171604 Dec 13 23:13:34.809868 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 585/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:34 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:35.830709 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:35.831733 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:35.845133 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:35.845917 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:35.847237 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:35.847945 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:36.000273 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:36.012822 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-1c4b0f6b-38e0-42a9-9355-3a47b0058ea3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.187995 Dec 13 23:13:36.013793 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 618/1203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:35 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:37.037399 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:37.038574 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:37.049770 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:37.050571 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:37.052403 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:37.053188 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:37.213587 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:37.221803 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-365058c5-814d-4312-b3d0-d71fc3be3ce9 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.190287 Dec 13 23:13:37.222368 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 586/1204] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:37 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:38.296447 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:38.297303 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:38.306668 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:38.307122 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:38.307905 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:38.308341 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:38.462421 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:38.474997 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-e5affa99-8a9c-4020-b2b9-2488361a8905 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.184693 Dec 13 23:13:38.475696 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 619/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:38 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:39.495744 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:39.496712 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:39.507179 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:39.507619 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:39.508400 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:39.508821 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:39.667090 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:39.679558 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-e4e8b48f-3d75-4355-b36a-aa8ef268f3a1 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1756 microversion: 2.1 time: 0.190041 Dec 13 23:13:39.680133 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 587/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:39 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:13:40.704638 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:13:40.705309 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:13:40.713246 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:40.713719 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:40.714484 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:13:40.714908 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:13:40.863589 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:13:40.872037 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-85eb856e-f02b-4050-a790-92dce8393f55 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1759 microversion: 2.1 time: 0.173463 Dec 13 23:13:40.872609 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 620/1207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:13:40 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:14:13.680869 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1184173127"}} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:14:13.681856 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:13.688591 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:13.689038 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:13.689882 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:13.690316 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:13.831585 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.network.security_group_api [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Removing security group cf0c29b5-9278-4d56-b7b1-7f9d4e74f7db from port 7d9199d5-570c-4348-b9fd-c69073779c2c Dec 13 23:14:14.195519 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-ef021b0c-b40d-4462-b51e-d72b7e4afad3 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/action" status: 202 len: 0 microversion: 2.1 time: 0.521318 Dec 13 23:14:14.199367 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 588/1208] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Dec 13 23:14:13 2021] POST /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:14:14.304438 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-8eb8cb4d-c981-4dc1-9c38-1e2152188d0f req-c78054cd-5f4f-4814-8dc4-83747b4bd95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd70637-7df5-414a-9d47-5569359290fa", "tag": "7d9199d5-570c-4348-b9fd-c69073779c2c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:14:14.308012 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:14:14.308012 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:14:14.317289 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-8eb8cb4d-c981-4dc1-9c38-1e2152188d0f req-c78054cd-5f4f-4814-8dc4-83747b4bd95b service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:14.318028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-8eb8cb4d-c981-4dc1-9c38-1e2152188d0f req-c78054cd-5f4f-4814-8dc4-83747b4bd95b service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:14.334436 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-8eb8cb4d-c981-4dc1-9c38-1e2152188d0f req-c78054cd-5f4f-4814-8dc4-83747b4bd95b service nova] Creating event network-changed:7d9199d5-570c-4348-b9fd-c69073779c2c for instance cfd70637-7df5-414a-9d47-5569359290fa on hv-cinder-79628 Dec 13 23:14:14.340435 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-8eb8cb4d-c981-4dc1-9c38-1e2152188d0f req-c78054cd-5f4f-4814-8dc4-83747b4bd95b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138210 Dec 13 23:14:14.341633 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 621/1209] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:14:15.379018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:15.379535 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:15.388150 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:15.388602 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:15.389414 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:15.389835 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:15.439043 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-50de5bef-9c35-4be2-8ce7-c8ab220a150c req-45f68090-dcbe-4479-814c-e4308b5a5938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd70637-7df5-414a-9d47-5569359290fa", "tag": "7d9199d5-570c-4348-b9fd-c69073779c2c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:14:15.440500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:14:15.440500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:14:15.447728 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-50de5bef-9c35-4be2-8ce7-c8ab220a150c req-45f68090-dcbe-4479-814c-e4308b5a5938 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:15.448375 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-50de5bef-9c35-4be2-8ce7-c8ab220a150c req-45f68090-dcbe-4479-814c-e4308b5a5938 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:15.461761 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-50de5bef-9c35-4be2-8ce7-c8ab220a150c req-45f68090-dcbe-4479-814c-e4308b5a5938 service nova] Creating event network-changed:7d9199d5-570c-4348-b9fd-c69073779c2c for instance cfd70637-7df5-414a-9d47-5569359290fa on hv-cinder-79628 Dec 13 23:14:15.467143 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-50de5bef-9c35-4be2-8ce7-c8ab220a150c req-45f68090-dcbe-4479-814c-e4308b5a5938 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089411 Dec 13 23:14:15.471036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 622/1210] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:14:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:14:15.476412 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lazy-loading 'services' on Instance uuid cfd70637-7df5-414a-9d47-5569359290fa {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:14:15.552031 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-34e1525e-c189-428b-b1f2-66ec5584781e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments/8faa9e2c-1f2f-482b-8454-961676078faf" status: 202 len: 0 microversion: 2.1 time: 0.177166 Dec 13 23:14:15.552730 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 589/1211] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:14:15 2021] DELETE /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments/8faa9e2c-1f2f-482b-8454-961676078faf => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:14:15.562477 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f754e366-70b6-434c-bacb-9b865305d00d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:15.563476 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f754e366-70b6-434c-bacb-9b865305d00d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:15.569656 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f754e366-70b6-434c-bacb-9b865305d00d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:15.570342 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f754e366-70b6-434c-bacb-9b865305d00d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:15.571341 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f754e366-70b6-434c-bacb-9b865305d00d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:15.571932 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f754e366-70b6-434c-bacb-9b865305d00d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:15.609372 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f754e366-70b6-434c-bacb-9b865305d00d tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051579 Dec 13 23:14:15.610377 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 623/1212] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:14:15 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:14:16.624482 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-597473b6-4500-4a57-a76a-cd7825a51d16 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:16.625509 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-597473b6-4500-4a57-a76a-cd7825a51d16 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:16.632194 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-597473b6-4500-4a57-a76a-cd7825a51d16 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:16.632644 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-597473b6-4500-4a57-a76a-cd7825a51d16 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:16.633467 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-597473b6-4500-4a57-a76a-cd7825a51d16 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:16.633876 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-597473b6-4500-4a57-a76a-cd7825a51d16 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:16.662638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-597473b6-4500-4a57-a76a-cd7825a51d16 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043020 Dec 13 23:14:16.663187 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 590/1213] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Dec 13 23:14:16 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 23:14:16.676461 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:16.676993 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:16.685176 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:16.685655 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:16.686431 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:16.686859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:16.764287 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] HTTP exception thrown: Instance cfd70637-7df5-414a-9d47-5569359290fa is not attached to volume 8faa9e2c-1f2f-482b-8454-961676078faf Dec 13 23:14:16.764887 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Returning 404 to user: Instance cfd70637-7df5-414a-9d47-5569359290fa is not attached to volume 8faa9e2c-1f2f-482b-8454-961676078faf {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:14:16.765750 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-f73f5283-7088-462a-81d4-a48bcaad63d6 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments/8faa9e2c-1f2f-482b-8454-961676078faf" status: 404 len: 154 microversion: 2.1 time: 0.096068 Dec 13 23:14:16.766329 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 624/1214] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Dec 13 23:14:16 2021] DELETE /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa/os-volume_attachments/8faa9e2c-1f2f-482b-8454-961676078faf => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:14:17.917735 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:17.918268 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:17.925182 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:17.925638 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:17.926405 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:17.926836 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:17.951678 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:14:18.028752 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-2a4dbaa0-a301-4d18-9a8a-440f5440324e tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 204 len: 0 microversion: 2.1 time: 0.114506 Dec 13 23:14:18.029460 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 591/1215] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:14:17 2021] DELETE /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:14:18.038712 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:18.039620 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:18.046539 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:18.047098 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:18.047859 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:18.048647 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:18.186178 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:14:18.194759 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-cd27bf58-f9a0-406f-b076-846df1abdf21 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1554 microversion: 2.1 time: 0.160852 Dec 13 23:14:18.195330 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 625/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:18 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:14:19.217596 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:19.218608 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:19.229142 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:19.229985 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:19.230888 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:19.231378 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:19.373652 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:14:19.381970 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-d6836c8b-451f-44b0-8730-471257e0a6e5 tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1554 microversion: 2.1 time: 0.171652 Dec 13 23:14:19.382530 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 592/1217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:19 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:14:20.400243 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:20.401526 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:20.411519 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:20.414187 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:20.415036 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:20.417905 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:20.461365 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [req-03622056-fa4c-42ce-bbaa-5e61595b5991 req-b8eae79f-62c4-4526-a20c-2d6cfd2b637a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd70637-7df5-414a-9d47-5569359290fa", "name": "network-vif-deleted", "tag": "7d9199d5-570c-4348-b9fd-c69073779c2c"}]} {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:14:20.463026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:14:20.463026 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: warnings.warn(msg) Dec 13 23:14:20.470838 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-03622056-fa4c-42ce-bbaa-5e61595b5991 req-b8eae79f-62c4-4526-a20c-2d6cfd2b637a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:20.471275 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [req-03622056-fa4c-42ce-bbaa-5e61595b5991 req-b8eae79f-62c4-4526-a20c-2d6cfd2b637a service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:20.482845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.compute.server_external_events [req-03622056-fa4c-42ce-bbaa-5e61595b5991 req-b8eae79f-62c4-4526-a20c-2d6cfd2b637a service nova] Creating event network-vif-deleted:7d9199d5-570c-4348-b9fd-c69073779c2c for instance cfd70637-7df5-414a-9d47-5569359290fa on hv-cinder-79628 Dec 13 23:14:20.487634 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [req-03622056-fa4c-42ce-bbaa-5e61595b5991 req-b8eae79f-62c4-4526-a20c-2d6cfd2b637a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029884 Dec 13 23:14:20.488547 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 593/1218] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:14:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 23:14:20.493569 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b320ab11a3e42b9bb329f72347f6ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb7851fcdf4c988491b5239cbeb015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:14:20.502058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6fd12c80-5774-4086-95d5-2b5020c4dd6f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 200 len: 1512 microversion: 2.1 time: 0.105685 Dec 13 23:14:20.502726 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 626/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:20 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 1512 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:14:21.524556 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:21.525738 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] [instance: cfd70637-7df5-414a-9d47-5569359290fa] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:21.535690 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:21.536127 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:21.536902 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:21.537327 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:21.551231 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] HTTP exception thrown: Instance cfd70637-7df5-414a-9d47-5569359290fa could not be found. Dec 13 23:14:21.551787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Returning 404 to user: Instance cfd70637-7df5-414a-9d47-5569359290fa could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:14:21.552597 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7b475369-952a-4454-9aad-91b805ddb73f tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa" status: 404 len: 111 microversion: 2.1 time: 0.035572 Dec 13 23:14:21.553132 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 594/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:21 2021] GET /compute/v2.1/servers/cfd70637-7df5-414a-9d47-5569359290fa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:14:21.563366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-6a1ebd27-90a1-4c6d-b0ca-a65302b2d9bd tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] Calling method '.version_select at 0x7f039a1d7670>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:21.583659 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-6a1ebd27-90a1-4c6d-b0ca-a65302b2d9bd tempest-TestMinimumBasicScenario-372925652 tempest-TestMinimumBasicScenario-372925652-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1907949425" status: 202 len: 0 microversion: 2.1 time: 0.025530 Dec 13 23:14:21.584206 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 627/1221] 10.222.0.13 () {58 vars in 1271 bytes} [Mon Dec 13 23:14:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1907949425 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:14:53.394176 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:53.394723 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:53.402779 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-12cff255-8541-4632-9e6f-d3bb45cffeb4 req-00a38700-0af6-498c-978c-a897adb7c2df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677ba26f-6428-422b-9a02-9910c221aa02", "tag": "4f9609b0-e000-4526-a95a-49b5d2e8dabb"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:14:53.404270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:14:53.404270 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:14:53.414107 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:53.414589 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:53.415381 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:53.415624 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-12cff255-8541-4632-9e6f-d3bb45cffeb4 req-00a38700-0af6-498c-978c-a897adb7c2df service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:53.415840 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:53.416063 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-12cff255-8541-4632-9e6f-d3bb45cffeb4 req-00a38700-0af6-498c-978c-a897adb7c2df service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:53.426994 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-12cff255-8541-4632-9e6f-d3bb45cffeb4 req-00a38700-0af6-498c-978c-a897adb7c2df service nova] Creating event network-changed:4f9609b0-e000-4526-a95a-49b5d2e8dabb for instance 677ba26f-6428-422b-9a02-9910c221aa02 on hv-cinder-79628 Dec 13 23:14:53.432424 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-12cff255-8541-4632-9e6f-d3bb45cffeb4 req-00a38700-0af6-498c-978c-a897adb7c2df service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033775 Dec 13 23:14:53.433228 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 628/1222] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:14:53.441768 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:14:53.524502 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-90b904d6-1db7-4b67-b32b-2d7860620ed4 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "DELETE /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 204 len: 0 microversion: 2.1 time: 0.133686 Dec 13 23:14:53.528762 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 595/1223] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:14:53 2021] DELETE /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:14:53.533974 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:53.534662 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:53.541608 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:53.542189 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:53.543140 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:53.543649 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:53.774211 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:14:53.783639 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-3803d650-2ff6-4c54-9b20-71197ac61d78 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1576 microversion: 2.1 time: 0.251784 Dec 13 23:14:53.795410 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 629/1224] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:53 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1576 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 23:14:54.806450 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:54.807119 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:54.813938 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:54.814383 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:54.815161 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:54.815592 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:54.956291 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:14:54.964680 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7113daa0-cf28-4491-9a9f-708f4edc9e08 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1457 microversion: 2.1 time: 0.163439 Dec 13 23:14:54.965279 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 596/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:54 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1457 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:14:55.540897 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-0dbe3fd9-5cbd-4e84-8566-838d096c4e84 req-b10f7bc4-5a11-4829-9826-def05812a9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677ba26f-6428-422b-9a02-9910c221aa02", "name": "network-vif-deleted", "tag": "4f9609b0-e000-4526-a95a-49b5d2e8dabb"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:14:55.542500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:14:55.542500 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:14:55.551695 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0dbe3fd9-5cbd-4e84-8566-838d096c4e84 req-b10f7bc4-5a11-4829-9826-def05812a9e3 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:55.552136 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0dbe3fd9-5cbd-4e84-8566-838d096c4e84 req-b10f7bc4-5a11-4829-9826-def05812a9e3 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:55.564771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-0dbe3fd9-5cbd-4e84-8566-838d096c4e84 req-b10f7bc4-5a11-4829-9826-def05812a9e3 service nova] Creating event network-vif-deleted:4f9609b0-e000-4526-a95a-49b5d2e8dabb for instance 677ba26f-6428-422b-9a02-9910c221aa02 on hv-cinder-79628 Dec 13 23:14:55.571071 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-0dbe3fd9-5cbd-4e84-8566-838d096c4e84 req-b10f7bc4-5a11-4829-9826-def05812a9e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033498 Dec 13 23:14:55.571664 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 630/1226] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:14:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:14:55.982011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:55.982590 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:55.989362 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:55.989837 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:55.991028 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:55.991467 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:56.022834 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:56.023203 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:56.023645 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lazy-loading 'fault' on Instance uuid 677ba26f-6428-422b-9a02-9910c221aa02 {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:14:56.066667 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:14:56.076817 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b04c88a3-bef4-4b74-a6fb-ea9ea18f6d49 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 200 len: 1229 microversion: 2.1 time: 0.098494 Dec 13 23:14:56.077448 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 597/1227] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:55 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:14:57.095364 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:14:57.096028 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: 677ba26f-6428-422b-9a02-9910c221aa02] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:14:57.107315 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:57.107858 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:57.109714 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:14:57.110214 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:14:57.125654 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] HTTP exception thrown: Instance 677ba26f-6428-422b-9a02-9910c221aa02 could not be found. Dec 13 23:14:57.126321 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Returning 404 to user: Instance 677ba26f-6428-422b-9a02-9910c221aa02 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:14:57.127162 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-5c141d86-c271-4e77-9ac9-a105c8baa9df tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02" status: 404 len: 111 microversion: 2.1 time: 0.036135 Dec 13 23:14:57.127735 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 631/1228] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:14:57 2021] GET /compute/v2.1/servers/677ba26f-6428-422b-9a02-9910c221aa02 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:15:00.251503 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:00.252018 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:15:00.254629 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-0c06cbe3-371a-48ed-98e1-d458312c95f3 req-532b13bd-23d8-4791-a5a3-91b994ca1728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede3bf14-ee3f-40c0-b84b-fcae9c5b698c", "tag": "c2f938ec-d363-431e-b58d-e8c5029dc15c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:15:00.256677 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:15:00.256677 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:15:00.258693 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:00.259144 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:00.259941 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:00.260598 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:00.265366 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0c06cbe3-371a-48ed-98e1-d458312c95f3 req-532b13bd-23d8-4791-a5a3-91b994ca1728 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:00.265842 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-0c06cbe3-371a-48ed-98e1-d458312c95f3 req-532b13bd-23d8-4791-a5a3-91b994ca1728 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:00.278357 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-0c06cbe3-371a-48ed-98e1-d458312c95f3 req-532b13bd-23d8-4791-a5a3-91b994ca1728 service nova] Creating event network-changed:c2f938ec-d363-431e-b58d-e8c5029dc15c for instance ede3bf14-ee3f-40c0-b84b-fcae9c5b698c on hv-cinder-79628 Dec 13 23:15:00.283495 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-0c06cbe3-371a-48ed-98e1-d458312c95f3 req-532b13bd-23d8-4791-a5a3-91b994ca1728 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033334 Dec 13 23:15:00.284674 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 632/1229] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:15:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:15:00.288632 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Going to try to terminate instance {{(pid=116225) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 23:15:00.379051 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-0fed0ef2-19d1-494a-a981-a986867d7961 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 204 len: 0 microversion: 2.1 time: 0.130971 Dec 13 23:15:00.379992 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 598/1230] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:15:00 2021] DELETE /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 23:15:00.390409 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:00.391150 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:15:00.397615 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:00.398063 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:00.398884 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:00.399311 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:00.617018 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.policy [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116226) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:15:00.625371 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-53bfc91a-43f2-4dae-a8e6-5583a67549b5 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1578 microversion: 2.1 time: 0.240504 Dec 13 23:15:00.626217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 633/1231] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:15:00 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1578 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:15:01.644791 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:01.645395 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:15:01.654627 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:01.655072 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:01.655849 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:01.656277 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:01.796625 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:15:01.807428 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-119bb5e1-b7ae-439b-902a-144c0477fb7d tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1459 microversion: 2.1 time: 0.166852 Dec 13 23:15:01.808001 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 599/1232] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:15:01 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1459 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:15:02.397345 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [req-3ba83612-d5ae-4549-a0e8-590a98f02290 req-e1b0cf63-d881-4a4a-9815-756ad63163a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede3bf14-ee3f-40c0-b84b-fcae9c5b698c", "name": "network-vif-deleted", "tag": "c2f938ec-d363-431e-b58d-e8c5029dc15c"}]} {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 23:15:02.399199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 23:15:02.399199 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: warnings.warn(msg) Dec 13 23:15:02.407109 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-3ba83612-d5ae-4549-a0e8-590a98f02290 req-e1b0cf63-d881-4a4a-9815-756ad63163a6 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:02.407556 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [req-3ba83612-d5ae-4549-a0e8-590a98f02290 req-e1b0cf63-d881-4a4a-9815-756ad63163a6 service nova] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:02.418914 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.compute.server_external_events [req-3ba83612-d5ae-4549-a0e8-590a98f02290 req-e1b0cf63-d881-4a4a-9815-756ad63163a6 service nova] Creating event network-vif-deleted:c2f938ec-d363-431e-b58d-e8c5029dc15c for instance ede3bf14-ee3f-40c0-b84b-fcae9c5b698c on hv-cinder-79628 Dec 13 23:15:02.424701 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [req-3ba83612-d5ae-4549-a0e8-590a98f02290 req-e1b0cf63-d881-4a4a-9815-756ad63163a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031044 Dec 13 23:15:02.425303 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 634/1233] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Dec 13 23:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 23:15:02.824171 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:02.824787 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:15:02.831391 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:02.831844 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:02.832630 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:02.833065 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:02.864011 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:02.864381 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:02.864823 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.objects.instance [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lazy-loading 'fault' on Instance uuid ede3bf14-ee3f-40c0-b84b-fcae9c5b698c {{(pid=116225) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 23:15:02.905679 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.policy [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33969662112e43f6a1c3dd76d70deca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41d0a6cbf194f8c89c606ddb13feecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116225) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 23:15:02.913206 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-3ecb23f4-128f-4896-be6c-0cb894860d8c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 200 len: 1230 microversion: 2.1 time: 0.092844 Dec 13 23:15:02.913813 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 600/1234] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:15:02 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 23:15:03.936316 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:03.937534 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: ede3bf14-ee3f-40c0-b84b-fcae9c5b698c] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:15:03.947659 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:03.948103 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:03.948876 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:03.949319 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:03.962857 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] HTTP exception thrown: Instance ede3bf14-ee3f-40c0-b84b-fcae9c5b698c could not be found. Dec 13 23:15:03.963445 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Returning 404 to user: Instance ede3bf14-ee3f-40c0-b84b-fcae9c5b698c could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:15:03.964276 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-8b13b4e8-3689-44dc-ada7-7e7902847648 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c" status: 404 len: 111 microversion: 2.1 time: 0.035622 Dec 13 23:15:03.964819 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 635/1235] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:15:03 2021] GET /compute/v2.1/servers/ede3bf14-ee3f-40c0-b84b-fcae9c5b698c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:15:04.426333 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:04.426883 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.compute.api [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116225) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:15:04.433584 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:04.434040 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:04.434845 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:04.435286 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG oslo_concurrency.lockutils [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:04.448759 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.wsgi [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] HTTP exception thrown: Instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 could not be found. Dec 13 23:15:04.449387 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Returning 404 to user: Instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 could not be found. {{(pid=116225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:15:04.450189 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-7ec99843-0411-4cdd-8589-b9ab0de6d245 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 404 len: 111 microversion: 2.1 time: 0.028020 Dec 13 23:15:04.450724 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 601/1236] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Dec 13 23:15:04 2021] DELETE /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:15:04.458771 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '>' {{(pid=116226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:04.459386 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.compute.api [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] [instance: e689912f-fc16-4bf4-8ec3-c7c312c41fb9] Fetching instance by UUID {{(pid=116226) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 23:15:04.465548 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:04.466001 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:04.466778 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 23:15:04.467217 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG oslo_concurrency.lockutils [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Lock "6ef68d83-174b-4609-9936-379f3e54427a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 23:15:04.480353 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.wsgi [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] HTTP exception thrown: Instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 could not be found. Dec 13 23:15:04.480933 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: DEBUG nova.api.openstack.wsgi [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Returning 404 to user: Instance e689912f-fc16-4bf4-8ec3-c7c312c41fb9 could not be found. {{(pid=116226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 23:15:04.481768 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO nova.api.openstack.requestlog [None req-4001601b-c0f1-4622-9e7a-5776f6562d3c tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9" status: 404 len: 111 microversion: 2.1 time: 0.026825 Dec 13 23:15:04.482289 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: [pid: 116226|app: 0|req: 636/1237] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Dec 13 23:15:04 2021] GET /compute/v2.1/servers/e689912f-fc16-4bf4-8ec3-c7c312c41fb9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 23:15:05.783552 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: DEBUG nova.api.openstack.wsgi [None req-b384ed8b-2d8a-4cd7-85c4-f10accfb7107 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] Calling method '.version_select at 0x7f039a06e5e0>' {{(pid=116225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 23:15:05.804968 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO nova.api.openstack.requestlog [None req-b384ed8b-2d8a-4cd7-85c4-f10accfb7107 tempest-TestVolumeBootPattern-346911594 tempest-TestVolumeBootPattern-346911594-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-757443627" status: 202 len: 0 microversion: 2.1 time: 0.025330 Dec 13 23:15:05.805975 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: [pid: 116225|app: 0|req: 602/1238] 10.222.0.13 () {58 vars in 1259 bytes} [Mon Dec 13 23:15:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-757443627 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 23:16:19.644061 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:16:19.644834 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: Mon Dec 13 23:16:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:16:20.415058 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:16:20.415987 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: Mon Dec 13 23:16:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:17:16.335454 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:17:16.339061 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: Mon Dec 13 23:17:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:18:00.556102 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:18:00.557184 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: Mon Dec 13 23:18:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:18:15.658518 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:18:15.659504 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: Mon Dec 13 23:18:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:19:39.663769 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:19:39.664400 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: Mon Dec 13 23:19:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:19:40.437995 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:19:40.438912 dv-cinder-796286-23-iscsi devstack@n-api.service[116226]: Mon Dec 13 23:19:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 23:20:02.650863 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 23:20:02.651828 dv-cinder-796286-23-iscsi devstack@n-api.service[116225]: Mon Dec 13 23:20:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!